Summary
Overview
Work History
Education
Skills
Certification
Hrj Id
Websites Portfolios Profiles
Timeline
Generic

Shyam Kumar

Jacksonville,USA

Summary

Accomplished Data Engineer with a proven track record at Discover, specializing in cloud-native solutions and automated ETL pipelines. Expert in Azure Synapse and Python, I enhanced data ingestion efficiency by 40%. Adept at leading teams and driving change, I excel in delivering impactful data strategies that support business analytics.

Overview

5
5
years of professional experience
1
1
Certification

Work History

Data Engineer

Discover
USA
05.2023 - Current
  • Designed and implemented cloud-native technical solutions using Azure Synapse, Data Lake, and Databricks.
  • Built automated and scalable ETL pipelines using Python, SQL Server, and DBT, improving data ingestion efficiency by 40%.
  • Architected migration plans to GCP and integrated legacy on-prem systems with hybrid cloud environments.
  • Led data aggregation strategies and defined transformation rules to support business analytics.

Data Engineer Specialist

WIPRO
India
08.2021 - 04.2023
  • Migrated on-prem Oracle systems to Snowflake using Python and DBT.
  • Developed Fabric Pipelines for ELT workflows and real-time data ingestion.
  • Implemented Kafka and Kinesis streaming for live asset monitoring.
  • Designed APIs to serve curated datasets for AI/ML models.
  • Conducted workshops to implement change management for CI/CD adoption.

Big Data & Cloud DevOps Engineer

Tech Mahindra
India
06.2020 - 07.2021
  • Built Delta Lake architecture is integrated with Snowflake for enterprise data warehousing.
  • Orchestrated dataflows using Airflow and Prefect for upstream data pipelines.
  • Used Apache Flink for real-time operational metrics processing.
  • Deployed Microsoft Fabric to unify analytics across business functions.
  • Automated infrastructure deployments using Jenkins and Terraform.

Education

Master's degree - computer science

05.2025

Bachelor of Science - Electronics and Communications Engineering

07.2021

Skills

  • Azure Data Factory
  • Azure Synapse Analytics
  • Azure Blob Storage
  • Azure Data Lake
  • AWS
  • Apache Spark
  • Hadoop
  • Hive
  • Kafka
  • Databricks
  • Impala SQL
  • Flink
  • Presto
  • SQL Server
  • PostgreSQL
  • MySQL
  • MongoDB
  • Snowflake
  • Cassandra
  • Python
  • Pandas
  • C#
  • SQL
  • Scala
  • Java
  • PowerShell
  • SSIS
  • Informatica
  • Talend
  • Apache NIFI
  • Pentaho
  • Power BI
  • Tableau
  • QlikView
  • Docker
  • Kubernetes
  • Terraform
  • CI/CD Pipelines
  • Jenkins
  • Git
  • Spotfire
  • Airflow
  • DBT

Certification

AWS CERTIFIED DATA ENGINEER ASSOCIATE

Hrj Id

#HRJ#fd5ae4bb-a697-4315-bd28-78b363880270

Websites Portfolios Profiles

https://www.linkedin.com/in/shyam-kumarj0927/

Timeline

Data Engineer

Discover
05.2023 - Current

Data Engineer Specialist

WIPRO
08.2021 - 04.2023

Big Data & Cloud DevOps Engineer

Tech Mahindra
06.2020 - 07.2021

Master's degree - computer science

Bachelor of Science - Electronics and Communications Engineering

Similar Profiles

CREATE PROFILE
Shyam Kumar