Naveen Soundararajan
Lead Data Engineer
Perumbakkam, Chennai,Tamil Nadu
Summary
Experienced Data Engineer with around 8 years of experience in implementation of various ELT pipelines for data ingestion. Worked extensively in technologies like Java/ Python/ SQL/ Google Cloud services like Big Query, Composer, Dataflow, Pub/Sub, Compute Engine, Cloud Storage, Logger, Data Transfer, Kubernetes Engine, Compute Engine, Cloud Functions, Cloud SQL, FireStore, Looker, IAM/ AWS services like S3, Redshift/ Airflow/ Apache Beam/ Apache Spark/ Hadoop
Overview
8
8
years of professional experience
4
4
years of post-secondary education
Work History
Sr. Software Engineer
Agilisium Consulting
Chennai, Tamil Nadu
03.2020 - Current
- Lead a team of 10 members which is involved in the end-end Data Engineering tasks.
- Debug the issues and provide an optimized solution
- Monitor the pipelines and make sure there is no failure in loading the data. In case of failures, handle them appropriately
- Identify the pain points of the team and provide automation solutions
- Validate the data with the source file/API and identify the anomalies
- Provide business & technical overview to the team and equip them both functionally and technically
- Manage the team & take proactive measures to avoid and in crisis situations
- Drive/attend daily and weekly scrum calls to discuss on the ongoing/future tasks & challenges
- Gathered, defined and refined requirements, led project design and oversaw implementation.
- Prepared documentation and analytic reports, delivering summarized results, analysis and conclusions to stakeholders.
- Contributed to internal activities for overall process improvements, efficiencies and innovation.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
Sr. Software Engineer
Xoriant Solutions Pvt Ltd
Chennai, Tamil Nadu
05.2019 - 03.2020
- Lead a team of 3 members which is involved in the end-end Data Engineering tasks.
- Analyze the requirements, estimate story points, design the solution, develop the code and test the code by loading the data into UAT tables in BQ
- Debug the issues and provide an optimized solution
- Monitor the pipelines and make sure there is no failure in loading the data. Incase of failures, handle them appropriately
- Involved in developing the automation of report module in GPOS system– Currently Analytics team manually request DE team to generate the reports for deviations in the data. This has been automated by introducing a new dashboard using Grafana in GPOS where the AE Team can create a report from UI and the failures will be automatically identified
- Involved in the calls where the new requirement for the application is being discussed and helped in the code level analysis to know the existing business functionality
Associate
Cognizant Technology Solutions
Chennai, Tamil Nadu
07.2014 - 05.2019
- Involved in developing major functionalities and design of the application – analyzed the requirement, provided the estimate, developed and unit tested
- Performed technical and functional analysis on the underwriting & billing application
- Part of the RateLevel team under the NextGen application and implemented various functional and business level changes
- Provided the knowledge transition of the NextGen application to the newly joined team members
Education
Bachelor of Engineering - Computer Science
Kongu Engineering College
Erode 08.2010 - 05.2014
Skills
Google Cloud Platform
Java
Python
SQL
BigQuery, Dataflow, Composer, Pub/Sub
PySpark
Apache Beam
Cloud SQL, Cloud Functions, Kubernetes, VM Instances, Compute Engine, FireStore, Logger, Looker, IAM, DataProc
JavaScript, HTML, CSS, Spring MVC, Docker, DBT
AWS RedShift, S3
Maven, Jenkins, JUnit4
Timeline
Sr. Software Engineer
Agilisium Consulting
03.2020 - Current
Sr. Software Engineer
Xoriant Solutions Pvt Ltd
05.2019 - 03.2020
Associate
Cognizant Technology Solutions
07.2014 - 05.2019
Bachelor of Engineering - Computer Science
Kongu Engineering College
08.2010 - 05.2014