DINESH KUMAR PANNIR SELVAM
Irving,Texas
Summary
At Prodapt North America, I spearheaded a team that revolutionized data warehousing for Lumen Technologies, achieving a 20% boost in ETL efficiency. My expertise in Google Cloud Platform and leadership in deploying scalable solutions earned me multiple accolades, including the Star of the Quarter, showcasing my technical prowess and innovative approach.
Overview
4
4
years of professional experience
1
1
Certification
Work History
Data Engineer
Prodapt North America
Irving, TX
04.2021 - Current
- Company Overview: Client: Lumen Technologies
- Led a 5-member team to migrate 200 Oracle tables to BigQuery using Informatica within a tight timeline, delivering a high-quality, cost-efficient data warehouse solution ahead of schedule
- Developed and deployed Kafka pipelines for real-time data streaming, functioning as both consumer and publisher in on-prem and GCP Confluent Kafka environments
- Architected a scalable, cost-effective data warehouse for ML use cases using GCP data engineering and ETL services
- Optimized ETL pipelines, resulting in a 20% increase in data processing speed
- Successfully implemented real-time cost monitoring solutions, reducing GCP costs by 99%
- Deployed CI/CD for APIs and batch pipelines across dev, QA, and prod environments, ensuring proper standards for a scalable and efficient end-to-end Generative AI cloud assistant use case
- Implemented an end-to-end GitHub Actions pipeline to automate Terraform deployment for GCP infrastructure, including automated alerts for any destructive changes
- Client: Lumen Technologies
- Star of the Quarter, Q3 2023 – Recognized for outstanding performance in delivering critical data engineering solutions
- Beyond Boundaries Limelight Award – Awarded for innovative solutions that drastically reduced GCP operational costs
- Spotlight Award – Acknowledged for leadership in implementing end-to-end data lake platforms and ETL solutions
Education
PGP - Data Science and Engineering
Great Learning, Great Lakes Institute of Management
01.2021
B.Tech - Electronic and Communication
Bharath University
Chennai01.2016
Skills
- Google Cloud Platform (GCP)
- Kafka
- Informatica
- GitHub Actions
- Kubernetes
- Docker
- Python
- SQL
- Terraform
- GitHub
- GENAI
Certification
Google Cloud Certified – Associate Cloud Engineer
Accomplishments
- Star of the Quarter, Q3 2023 – Recognized for outstanding performance in delivering critical data engineering solutions
- Beyond Boundaries Limelight Award – Awarded for innovative solutions that drastically reduced GCP operational costs
- Spotlight Award – Acknowledged for leadership in implementing end-to-end data lake platforms and ETL solutions
Timeline
Data Engineer
Prodapt North America
04.2021 - Current
PGP - Data Science and Engineering
Great Learning, Great Lakes Institute of Management
B.Tech - Electronic and Communication
Bharath University
Similar Profiles
Mudoh NjiwahMudoh Njiwah
Program/Project Manager at Prodapt North America Inc.Program/Project Manager at Prodapt North America Inc.
Naftale HirdNaftale Hird
Investments Compliance Manager at QBE North America, Investments Compliance North AmericaInvestments Compliance Manager at QBE North America, Investments Compliance North America
Caleb HernandezCaleb Hernandez
Service Advisor at Nissan North America, Inc.Service Advisor at Nissan North America, Inc.