Bharat Subedi
Summary
Senior Data Engineer with extensive experience building scalable data platforms using Databricks, Snowflake, PySpark, Kafka, Airflow, and AWS. Skilled in architecting modern lakehouse solutions, streaming pipelines, high-volume ETL frameworks, and legacy modernization initiatives optimized for analytics, reporting, and operational workloads.
Overview
15
15
years of professional experience
Work History
Sr Data Engineer
Centene
07.2022 - Current
- Designed and supported AWS-based healthcare data lake solutions using S3, EMR, Redshift, and Athena for scalable enterprise analytics.
- Implemented Snowflake optimization strategies including clustering, query tuning, and Snowpipe automation for high-volume healthcare ingestion pipelines.
- Developed secure cloud-native ETL frameworks integrating Snowflake, Databricks, and AWS services to support enterprise reporting and operational analytics.
- Built scalable cloud ingestion pipelines leveraging AWS services and Delta Lake architecture to improve data availability and downstream processing efficiency.
- Partnered with architecture and governance teams to implement secure PHI-compliant cloud data solutions across AWS and Snowflake environments.
- Designed Databricks Lakehouse architecture using Bronze/Silver/Gold medallion patterns for healthcare claims processing.
- Built PySpark and Delta Lake pipelines supporting batch and near real-time healthcare data ingestion.
- Implemented CDC, Delta MERGE, and historical tracking strategies for incremental processing.
- Developed Kafka and Spark Structured Streaming pipelines for healthcare event processing.
- Optimized Spark workloads using partitioning, caching, and broadcast joins.
- Designed Azure Data Factory orchestration pipelines for enterprise ETL workloads and operational reporting processes.
- Implemented CI/CD deployment workflows using Azure DevOps and Git-based version control for ETL and reporting solutions.
- Collaborated with architecture and infrastructure teams to support cloud modernization initiatives using Azure services and Snowflake.
- Built reusable deployment and configuration frameworks to streamline ETL releases across development, QA, and production environments.
- Led performance optimization and operational stabilization efforts for enterprise reporting and Azure-based data integration pipelines.
- Created reusable ETL frameworks in Python/PySpark and Airflow orchestration workflows.
- Supported HIPAA-compliant PHI handling, data quality validation, and legacy SSIS-to-cloud modernization.
- Automated operational reporting workflows and improved reporting consistency across business units.
- Partnered with vendor and infrastructure teams to support enterprise data integration and migration initiatives.
Sr Data Engineer
Service King Collision Repair
08.2021 - 07.2022
- Integrated CCC ONE application data with enterprise reporting platforms using API-based and batch transaction processing workflows.
- Developed ETL pipelines processing repair orders, technician labor hours, supplements, payroll, and operational KPI reporting from CCC ONE systems.
- Worked with transactional repair-order and body shop operational data to support payroll reconciliation, technician productivity tracking, and financial reporting.
- Built SQL validation and reconciliation frameworks to ensure consistency between CCC ONE operational transactions, payroll systems, and reporting databases.
- Collaborated with estimators, body shop managers, accounting teams, and vendor support teams to troubleshoot transaction and integration issues across CCC ONE workflows.
- Developed scalable Azure Data Factory pipelines with parameterized frameworks, dynamic data flows, and reusable ingestion patterns.
- Integrated Azure Blob Storage and Azure Data Lake Storage (ADLS) solutions to support enterprise-scale reporting and analytics workloads.
- Implemented monitoring, alerting, and operational support processes for Azure-based ETL pipelines to improve SLA reliability.
- Worked extensively with Azure SQL, T-SQL optimization, and cloud integration patterns to support operational and analytical workloads.
- Supported CI/CD release automation using Azure DevOps pipelines, Git branching strategies, and environment promotion standards.
- Collaborated with enterprise architecture teams on cloud migration initiatives leveraging Azure services and Snowflake integration.
- Built metadata-driven ETL solutions and automated deployment workflows to improve maintainability and reduce manual operational effort.
- Developed cloud ETL pipelines using Azure Data Factory, SQL Server, Snowflake, and Redshift.
- Built SQL-based reconciliation and validation frameworks to ensure operational reporting accuracy.
- Integrated vendor APIs and operational systems into centralized reporting and analytics platforms.
- Designed Type 2 historical tracking models and reporting workflows for operational analytics.
- Optimized SQL and Teradata workloads using explain plans, indexing, and statistics collection.
- Worked closely with business analysts and QA teams during requirement gathering, testing, and production deployments.
SQL/ETL Developer / Sr Consultant
Cognizant
10.2019 - 08.2021
- Developed healthcare ETL solutions supporting claims, provider, member, and encounter workflows.
- Worked with EDI transaction formats including 837, 835, 834, 270/271, NCPDP, 999, 277CA, and MAO files.
- Built complex T-SQL stored procedures, views, and SSIS workflows for healthcare reporting systems.
- Supported Facets, QNXT, and EDM integrations for Medicare and Medicaid encounter processing.
- Performed production support, data validation, gap analysis, and defect resolution for healthcare clients.
- Built and maintained enterprise SSIS workflows supporting reporting and operational data integration.
- Collaborated with client teams to troubleshoot ETL failures, performance bottlenecks, and reporting issues.
- (Healthcare)
ETL / BI Developer
TriZetto
10.2014 - 10.2019
- Designed SSIS packages, SQL stored procedures, views, and reporting data structures for healthcare and enterprise reporting.
- Built ETL workflows to extract, transform, validate, and load data into staging and reporting databases across Facets and QNXT environments.
- Implemented master-child SSIS patterns, dynamic variables, error handling, logging, and email notifications.
- Created ad hoc SQL queries and scheduled report delivery processes for business stakeholders.
- Supported migration and deployment of SSIS packages across development, staging, and pre-production environments.
SSIS Developer
Minnesota State University Moorhead
08.2011 - 07.2014
- Designed SQL Server database objects including tables, views, stored procedures, functions, triggers, and indexes using T-SQL.
- Developed SSIS packages to import, clean, and load data from MS Access, Excel, flat files, and relational sources.
- Created student enrollment and business reporting datasets using SQL views, stored procedures, and ad hoc queries.
- Supported data validation, troubleshooting, and scheduled ETL task execution for internal reporting teams.
Education
Bachelor's - Computer Information Technology
Minnesota State University Moorhead
Minnesota12-2013
Minor - Computer Science
Minnesota state univerisity Moorhead
Moorhead12-2013
Skills
- Python
- SQL (T-SQL, PL/SQL)
- PySpark
- Spark SQL
- Databricks
- Delta Lake
- Kafka
- Airflow
- Snowflake
- AWS
- Azure Data Factory
- SQL Server
- Microsoft Entra Id
- DeveOps (docker, terraform, zenkins, git)
- SSIS
- Talend
- Informatica
Timeline
Sr Data Engineer
Centene
07.2022 - Current
Sr Data Engineer
Service King Collision Repair
08.2021 - 07.2022
SQL/ETL Developer / Sr Consultant
Cognizant
10.2019 - 08.2021
ETL / BI Developer
TriZetto
10.2014 - 10.2019
SSIS Developer
Minnesota State University Moorhead
08.2011 - 07.2014
Minor - Computer Science
Minnesota state univerisity Moorhead
Bachelor's - Computer Information Technology
Minnesota State University Moorhead