Data Engineer with 7.5 years of experience in designing, developing, and supporting enterprise data lake architectures across Azure cloud and on-premises platforms. Hands-on expertise in Azure Data Lake Storage, Azure Data Factory, Azure Synapse, Spark SQL, and Hadoop, with strong skills in ETL development, performance tuning, data governance, and production support for analytics and BI workloads.
Overview
8
8
years of professional experience
Work History
Data Engineer
Wipro Technologies - Client: US Bank
Saint Paul, MN
11.2018 - Current
Designed, built, and supported scalable data pipelines, processing high-volume structured and semi-structured data using SQL and Apache Spark.
Developed and optimized ETL/ELT frameworks to ingest data from on-premises and cloud systems into enterprise data lakes.
Led and supported cloud migration initiatives, modernizing legacy on-prem platforms to Azure data lake solutions using ADLS and Azure Data Factory.
Improved pipeline performance by 30–40% through Spark tuning, query optimization, partitioning, and efficient data modeling.
Implemented cloud-based data solutions on Azure, leveraging services such as ADLS/S3, and Azure Data Factory.
Implemented robust data quality, validation, and monitoring frameworks, ensuring data accuracy, reliability, and SLA compliance.
Automated scheduling and dependency management using Airflow and Autosys, significantly reducing manual operations and failures.
Partnered with DevOps teams to implement CI/CD pipelines, source control, and automated deployments using Git.
Managed and supported 20,000+ ETL pipelines across hybrid on-prem and Azure environments.
Provided BAU production support, resolving incidents and problem records, performing root cause analysis, and maintaining high system availability.
Mentored junior engineers and led a team of 16, driving delivery excellence, operational stability, and knowledge sharing.
Reliability Engineer
Wipro Technologies - Client: US Bank
Coimbatore, Tamil Nadu
05.2018 - 10.2018
Provided 24/7 production support for Managed File Transfer (MFT) applications.
Monitored and maintained secure file transfer processes to ensure uninterrupted data exchanges across internal systems and external partners. Handling inbound and outbound file transfers for over 8,000 customers.
Performed log analysis, job restarts, and file validation to ensure successful delivery.
Maintained CMDB customer inventory with the latest information, configuration guides, and troubleshooting documentation.
Education
Master of Science - Computer Applications And Infrastructure
Software Engineer at Wipro Technologies(Deputed to ICICI Bank - Client Location)Software Engineer at Wipro Technologies(Deputed to ICICI Bank - Client Location)