Mahesh Yenuganti
Dublin,California
Summary
Experienced Data Engineer skilled in designing and building scalable data platforms and distributed processing systems with Apache Spark, AWS, Azure, and Snowflake. Developed high-volume batch and near real-time data pipelines, implemented data modeling at scale, and supported analytics and machine learning workloads. Focused on data reliability, quality, and DataOps practices in production environments. Results-driven Data Engineer with proven skills in data pipeline design, ETL process improvement, and SQL programming. Optimized data workflows to enhance reporting efficiency and ensure data quality.
Overview
3
3
years of professional experience
Work History
Data Engineer
Patelco Credit union
dublin, California
06.2024 - Current
- Designed and implemented scalable AWS-based data pipelines, enhancing data availability for analytics by 40%.
- Built incremental ingestion pipelines utilizing CDC and watermarking, decreasing data latency to under six hours.
- Developed AWS Glue (PySpark) jobs processing over 10 million records daily, improving efficiency by 30%.
- Created an S3-based data lake, optimizing storage costs by 25% through efficient partitioning and file formats.
- Implemented event-driven workflows with Lambda and S3 triggers, cutting manual execution of pipelines by 50%.
- Loaded curated data into Snowflake via external stages, increasing ingestion speed by 35%.
- Optimized Snowflake queries through clustering and performance tuning, reducing dashboard query time to under five minutes.
- Collaborated with BI teams to deliver analytics-ready datasets, minimizing report generation time by 40%.
Associate Data Engineer
Service Oriented Solutions
Dublin, California
01.2023 - 05.2024
- Developed end-to-end data pipelines processing over 5 million records daily from diverse sources into cloud platforms.
- Designed spark-based transformation workflows, enhancing processing efficiency by 25 to 30 percent.
- Built automated ingestion pipelines for batch and incremental loads, minimizing manual intervention by 70 percent.
- Implemented data validation and reconciliation logic, increasing data accuracy across systems by 45 percent.
- Optimized ETL jobs through partitioning and query tuning, cutting execution time by approximately 30 percent.
- Delivered curated datasets to analytics teams, accelerating reporting and reducing turnaround time by 35 percent.
Education
Master of Science - Computer Science
Rowan University
Glassboro, NJ05-2023
Bachelor of Science - Computer Science
KL University
India05-2021
Skills
- Data pipeline design
- ETL process improvement
- Data pipeline automation
- Data quality assurance
- Data modeling
- SQL programming and expertise
- NoSQL database management
- Stream processing frameworks
- Cloud data governance
- Data governance frameworks
- Data retrieval techniques
- Business analytics
- Problem solving and analytical skills
- Team collaboration tools
Timeline
Data Engineer
Patelco Credit union
06.2024 - Current
Associate Data Engineer
Service Oriented Solutions
01.2023 - 05.2024
Master of Science - Computer Science
Rowan University
Bachelor of Science - Computer Science
KL University