Summary
Overview
Work History
Education
Skills
Accomplishments
Certification
Timeline
NAVIN KUMAR YADAV

NAVIN KUMAR YADAV

Summary

  • Design, Lead development of Enterprise Cloud Data Platform using Databricks, Snowflake, AWS Glue, Teradata Vantage
  • Design Data Observability, Audit, Balance & Control, Data Quality, Security for data products pipelines.
  • Design self-service pattern/framework for data product registration, ingestion, curation and outbound for data products.
  • Implemented interoperability HI2 on AWS cloud which ingests billions of records across various data domains like Claim, Clinical, Providers, Benefits, member etc
  • Enterprise self-service scalable data pipeline between Snowflake and Databricks which supports Databricks delta table CDC using native spark.
  • Design ingestion framework for batch or near real time streaming using Kafka, Qlik, AWS Services like Kinesis, Databricks Auto Loader.
  • Perform performance, cost analysis for different data size work load across Databricks, Snowflake, AWS Glue , Teradata vantage. These metrics refer by data engineer to decide and estimate work loads and select right technology for the use cases.
  • Design dynamic report capability for elastic search
  • Implemented US Government compliance Price Transparency in Coverage by building out data pipelines processing large scale data.
  • Participated in various Technologist Community and Mentoring lead and solution architects.
  • Perform various PoCs on machine learning and data engineering for various services like AWS Sagemaker
  • Setup offshore delivery teams by partnering with Cigna partner vendors

Overview

25
25
years of professional experience
1
1
Certification

Work History

Architecture Principal

Cigna Health Insurance
01.2023 - Current

Solution Architecture Framework and Pattern

  • Building next generation self-service data pipeline which supports Data Observability, Audit Balance & Control, Data Quality and Data security framework
  • Analyzing all existing enterprise framework of Lakehouse which includes Injection, Transformation and Consumptions and transform to new enterprise data pipeline
  • Design various ingestion pattern for different use cases like Qlik to S3, external on-prem DBMS to cloud databricks directly, databricks data sharing, Snowflake no copy concept etc
  • Member of cloud center of excellence and review and approve cloud patterns

Application Development

  • Exiting on-prem Hadoop (72 Application) migrating to Databricks

Role and Responsibilities Delivery manager for 3 vendor sprint team

Environment AWS Services - S3, Glue, Lambda, DynamoDB, SNS, SQS, Cloud watch; Databircks - Delta table, AutoLoader, DLT; Airflow, Kafka, Splunk.

Architecture Principal

Cigna Health Insurance
06.2022 - 12.2022

Solution Architecture Framework and Pattern

  • Perform various PoCs on machine learning and data engineering for various services like AWS Sagemaker
  • Enterprise self-service scalable data pipeline between Snowflake and Databricks which supports delta table CDC.
  • Perform performance, cost analysis for different data size work load across Databricks, Snowflake, AWS Glue , Teradata vantage.
  • Member of cloud center of excellence and review and approve cloud patterns.

Application Development

  • Migration Enterprise DW on Teradata on-prem to Teradata vantage on AWS cloud
  • Clinical Data subject area build on Enterprise Data Lake on Databricks

Role and Responsibilities: Delivery Lead for 5 sprint team

Environment: AWS Services - S3, Glue, Lambda, Step function, Cloud watch; Pyspark, Airflow, Kafka, Splunk, ElasticSearch.

Senior Advisor

Cigna Health Insurance
08.2019 - 12.2021

Solution Architecture Framework and Pattern

  • Perform various PoCs on machine learning and data engineering for various services like AWS Sagemaker
  • Enterprise self-service scalable data pipeline between Snowflake and Databricks which supports delta table CDC
  • Perform performance, cost analysis for different data size work load across Databricks, Snowflake, AWS Glue , Teradata vantage
  • Member of cloud center of excellence and review and approve cloud patterns

Application Development

  • Migration Enterprise DW on Teradata on-prem to Teradata vantage on AWS cloud
  • Clinical Data subject area build on Enterprise Data Lake on Databricks

Role and Responsibilities: Delivery Lead for 5 sprint team

Environment: AWS Services - S3, Glue, Lambda, Step function, Cloud watch; Pyspark, Airflow, Kafka, Splunk, ElasticSearch

VP Technology

JP Morgan Chase Merchant Services
01.2015 - 07.2019

Built Enterprise Data warehouse using Oracle, Informatica and Tableau. Size of Data ware house is around 750 TB

Building Data Lake (Kafka, Hadoop, Spark, Hive, Java) as part of Modernization .Injected data is around 500 M every day

Cassandra NoSQL based ODS for Chase Business online application

  • Migrated and onboarded 150 K merchants
  • Elastic search based ODS for Merchant Activity and Merchant Fees Report

Roles & Responsibilities:

  • Work closely with the product team to design and deliver an ongoing product development plan for data solutions
  • Leading a team of Data Engineers to deliver application solution
  • Data Design authority for data modeling and data architecture
  • Coordinate with all stake holders like Production Support, Audit, PCI compliance, Data Governance, Product, End users
  • Work closely with Data Review Board, Data management council and Architecture Review Board for the review of existing issues and enhancement
  • Involved in establishing Data Governance, metadata management and data modeling best practices for Big data and RDBMS
  • Capacity planning and Performance Engineering for Data warehouse and Data Lake

Environment:

  • AWS, Hadoop, EMR, Spark, Cassandra, Kafka, Tableau, Elastic Search, Oracle 11g, Golden Gate, CA Erwin, Abinishio MDR (Meta Data Repository)

Senior Technology Architect

TTI Inc
04.2014 - 12.2014

Design Foundation Database and EDW

  • Currently TTI runs applications like Quote, Sales Order, Vendor Order, MRP, Product, Account Payment and Account receivable on Mainframe platform using VSAM file
  • As part of Legacy modernization Mainframe need to be sunset and Data Foundation and EDW need to be created using Oracle RDBMS.

Roles & Responsibilities:

  • Define data Synchronization strategy between Mainframe and Oracle till Mainframe sunset
  • Design Data model – Conceptual, Logical and Physical for Data Foundation with business improvement
  • Defining ETL roadmap using SSIS, Oracle and Mainframe scripts for data loading
  • Involved in effort estimation, feasibility study and capacity planning for new Oracle database servers
  • Defining strategy for performance engineering and Data Quality
  • Leading team of 2 onsite tech lead,4 offshore tech lead and 1 offshore data architect

Environment: Mainframe VSAM, Oracle, SSIS, CA Erwin

Sr Technology Architect

BELL HELICOPTER HURST
10.2010 - 03.2013

Project: Build Engineering DW and Data Mart

Roles & Responsibilities :

  • Data Modeler – Design Data Model for DW and Data Mart using Dimensional data modeling concepts, Design conformed dimensions , Database Capacity planning and optimization.
  • BI Architect – Defined standard ETL process, Data Quality and Meta data strategy using SAP BODS ETL tool, Design Job flow, Work flow and data mapping. Defines standard for developing SAP BO universe.
  • Developed SAP BODS Jobs, Workflow, Data Flow and transformation logic
  • Created one SAP BO Universe – Engineering using extended star schema. It involves 60 tables and having 3 contexts.
  • Worked with business users to formulate business and data requirements, translated the requirements into ETL scripts and Universe Design.
  • Created Engineering Dashboard using Qlikview.
  • Responsible for effective communication between offshore and onsite team and provide regular project status to the Project Manager & Delivery Project Executive.

Environment: SAP BODS 4.0, SAP BOBJ, Qlikview

Senior Manager

Toyota Motors
10.2009 - 10.2010

Dealer Enterprise System

  • Roles & Responsibilities:
  • Lead 5 onsite and 20 offshore members team
  • Managing customer and offshore delivery team
  • Involved in developing ER data models of critical modules for this OLTP system
  • Communication Plan, Managing stakeholders, Team Development, Appreciation of Quality and Process frameworks

Environment: DB2 9.1, DB2 performance tuning utilities, WebSphere, Ramco Virtual Works, ERWIN, Linux, Visual Source Safe

Application Development Manager

Boeing
04.2004 - 09.2009

ME&P Workload Management and Electronics schematic and wiring analytical tool

This project is all about managing work flow and approval process for any document, design or services Boeing 787 Program wanted to move away from book paradigm and provide online access to airline customers pertaining to their aircraft data consists of data and drawing .Any kind of maintenance and changes incorporated in aircraft is being captured in source system and then flow into this data delivery system .

  • It connects to different sources like Enovia, CAD station etc
  • It consists of Adhoc and canned report

Roles & Responsibilities:

  • Lead 8 members team
  • Managing customer and offshore delivery team
  • Interact with Business Analysts and understand the Business requirements to meet the client requirements
  • Project Planning, Monitoring and Tracking
  • Communication Plan, Managing stakeholders, Team Development, Appreciation of Quality and Process frameworks

Technical Lead

Chrysler
09.2002 - 03.2004

Specify the Vehicle

Specify the Vehicle consists of six applications which are in Mainframe technology using DB2 .Few of them are having Java as UI too . Infosys has maintenance and enhancement related activities for these

  • Roles & Responsibilities:
  • Build data model, Script database object and setup quality process
  • Lead team of 8 persons
  • Software, Java, Servlet, DB2

Technical Lead

GoldMan Sachs
05.1999 - 08.2002

MIS applications for Private wealth management and Global Credit Applications

  • Maintenance and Enhancement of web applications which received various feed files from upstream Mainframe application

Roles & Responsibilities:

  • Requirement gathering, Design walk through with customer, Code review and code deployment and build
  • Quality process setup and offshore coordination

Education

Bachelor of Engineering - Computer Science

MNIIT
AWS Architecture Associate certified.Pending Patent forRunners up JP Morgan Chase Hackathon two times i– Developed Merchant Fraud Detection using deep machine learning algorithm.Eight Boeing pride awards for extraordinary contribution at BoeingAwarded “Certification of Appreciation

Graduate Certificate - Data Science

Harvard Extension School, Cambridge, Massachusetts

Skills

  • Skill Set:
  • AWS Services AWS Glue, Kinesis, Lambda, Step Functions, AWS Batch, AWS DMS Elastic
  • Services, AWS managed Kafka, AWS Sage Maker
  • Data Lake on Cloud Databricks Lakehouse, Snowflake, AWS Glue ETL, AWS EMR
  • Big Data on-Prem HDFS, Hive, Cassandra, Spark
  • Language Python, R
  • RDBMS:
  • IBM DB2, Microsoft-SQL Server, Oracle, Sybase, MS-Access
  • In Memory Database: SAP HANA, Qlikview (QVD)
  • Data Modeling Tools: Oracle Designer, ERWIN
  • BI Intelligence Tools: Tableau, SAP BO 40 – Webi, Universe, Explorer
  • ETL Tools: Informatica, SAP BODS, SAP BW 74
  • Dashboard: Qlikview, Elastic Search Kibana, Tableau
  • O/S: AIX, UNIX, Linux, Windows
  • Metadata Tools: SAP Data steward, Abinishio MDR (Meta Data Repository)

Accomplishments

  • Need to revisit

Certification

  • AWS Architecture Associate certified
  • Cigna Lab Coat Award for invention and filing patent "SYSTEM AND METHODS FOR AUTOMATED DYYNAMIC DATABASE SEARCH QUERIES". Patent Ref is ESRX-387US1
  • Runners up two times for JP Morgan Merchant services Hackathon - "Merchant Fraud Detection using deep machine learning algorithm"
  • Eight Boeing pride awards for extraordinary contribution at Boeing


Timeline

Architecture Principal - Cigna Health Insurance
01.2023 - Current
Architecture Principal - Cigna Health Insurance
06.2022 - 12.2022
Senior Advisor - Cigna Health Insurance
08.2019 - 12.2021
VP Technology - JP Morgan Chase Merchant Services
01.2015 - 07.2019
Senior Technology Architect - TTI Inc
04.2014 - 12.2014
Sr Technology Architect - BELL HELICOPTER HURST
10.2010 - 03.2013
Senior Manager - Toyota Motors
10.2009 - 10.2010
Application Development Manager - Boeing
04.2004 - 09.2009
Technical Lead - Chrysler
09.2002 - 03.2004
Technical Lead - GoldMan Sachs
05.1999 - 08.2002
MNIIT - Bachelor of Engineering, Computer Science
Harvard Extension School - Graduate Certificate, Data Science
NAVIN KUMAR YADAV