Summary

Overview

Work History

Education

Skills

Personal Information

Timeline

NARENDRA B. JALLI

Richmond,TX

Summary

Senior Databricks Engineer specializing in cloud ETL solutions and data modernization. Engineered advanced PySpark pipelines and architected Delta Lake layers to drive significant improvements in data processing. Spearheaded cloud migrations and established robust governance frameworks, enhancing data accessibility and operational reliability.

Overview

years of professional experience

Work History

Senior Databricks Engineer / ETL Solution Architect

Cigna Health Care

01.2009 - Current

Databricks Engineering & Lakehouse Development
Engineered largescale PySpark pipelines replacing legacy Informatica mappings.
Designed Databricks bronze/silver/gold layers using Delta Lake (OPTIMIZE, ZORDER, MERGE).
Built Auto Loader ingestion patterns for streaming and incremental processing.
Implemented Unity Catalog for governance, lineage, and secure access.
Tuned Spark jobs using partitioning, caching, broadcast joins, and AQE.
Created Databricks workflow orchestration with dependency management and retries.
Cloud Migration & Modernization
Led enterprise migration from Informatica to Databricks, resulting in successful conversion of hundreds of mappings.
Built automated SourcetoTarget Mapping (STM) frameworks for Databricks.
Integrated Databricks with AWS S3 for landing, staging, curated zones.
Conducted Snowflake vs Redshift POCs, leading to selection of Snowflake as the preferred data platform.
Mainframe (VSAM) Integration
Extracted and transformed VSAM data using Informatica PowerExchange.
Rearchitected VSAM ingestion pipelines into Databricks using Auto Loader + Delta MERGE.
Extracted, transformed, and loaded data from sources such as VSAM files and SAP.
Migrated VSAMsourced marts into cloud Lakehouse structures.
Informatica Architecture & Legacy Expertise
Designed ETL architecture and SourcetoTarget mappings (?1.1?10.4).
Built XML ingestion pipelines and recreated XML outputs for downstream consumers.
Implemented Informatica best practices, reusable objects, workflow variables, mapping parameters.
Leadership & Delivery
Mentored Databricks and ETL developers on PySpark optimization and Lakehouse patterns.
Led daily standups, sprint planning, PI demos, and cross-team collaboration.
Delivered ad hoc reporting using Tableau, Looker, Business Objects.
Ensured performance, scalability, and reliability across ETL platforms, contributing to overall operational efficiency.

Sr. Lead Developer / Architect

SolidWorks

01.2008 - 12.2008

Streamlined encounter data standardization across multiple systems, improving data consistency.
Delivered 24x7 production support and executed performance tuning, ensuring system reliability.
Developed Informatica mappings for enterprise repository and master data, enhancing data accessibility.

Sr. Lead Developer / Sr. Data Analyst

Centene Corporation

07.2007 - 12.2007

Led development teams in creating healthcare software solutions for diverse client needs.
Implemented best coding practices to enhance software quality and maintainability.
Developed Informatica mappings to implement Data Warehouse design enhancements.
Authored BRDs and design documents to define project scope and ETL requirements.
Collaborated with cross-functional teams to design user-friendly interfaces and experiences.

Programmer Lead / Data Modeler

Medica

08.2006 - 06.2007

Designed data systems, logical/physical models, and data warehouse structures to support analytical needs.
Built SCD Type2 mappings and stored procedures to enable accurate historical data tracking.
Developed software solutions to enhance patient data management systems.
Collaborated with healthcare teams to identify software needs and requirements.
Implemented code reviews to ensure quality and consistency in programming practices.

ETL Informatica Consultant / Siebel Analytics Developer

United Health Care

04.2005 - 08.2006

Developed prototype reports and customized Siebel Analytics metadata layers to enhance data visualization and reporting capabilities.
Collaborated with cross-functional teams to develop healthcare solutions.
Conducted in-depth analysis of client needs and expectations.
Facilitated workshops to gather insights and drive project requirements.

ETL Informatica Developer

Blue Cross Blue Shield

07.2004 - 04.2005

Developed ETL processes using Informatica for healthcare data integration.
Developed Informatica mappings for CDC processes to facilitate real-time data integration.
Extracted and transformed data from VSAM files and SAP into DB2 data marts to support analytics and reporting.
Collaborated with cross-functional teams to gather data requirements and specifications.
Designed and maintained data mapping documents for complex transformations.