Highly experienced Data Engineer with 13+ years of professional experience in developing complex technical solutions for various retails and finance industries. Over the course of 13 years, accumulated more than 6 years of expertise in implementing secure, cost-efficient data solutions in the field of Data Engineering and Data Science.
Senior Data Engineer proficient in Python., Snowflake, Netezza ,Informatica, Talend, SAP BODS, PySpark, AWS, AWS Machine Learning.
Architected multiple Python applications/projects to consolidate data from different platforms and in different formats into a unified big data platform (ETL layers).
Optimized, and implemented multiple models for the E-commerce customer using AWS Sagemaker in my role as a Data Scientist.Critical Thinker to address customer support issues quickly and consistently exceeds performance standards.
Built a robust framework that successfully synchronized data from diverse systems into a centralized snowflake database.
Analysis of the gathered requirements, time estimation to complete the Data modelling, task, preparation of design documents, design reviews with manager as well as clients, Unit test case document preparation, development, testing and deployment of the application as per project planning.
Supervised a team of eight professionals in the seamless migration of an e-commerce vendor's application from a traditional Data center to the cutting-edge AWS platform.
Full stack developer specialized in Node.js & Mongo DB and successfully developed backend applications for various sectors including Retail, Media, and Finance.
Won “Associate of the year for 2018 and 2013” award as well.
Overview
12
12
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Hexaware Technologies Ltd.
12.2020 - Current
Architected multiple Python applications/projects to consolidate data from different platforms and in different formats into a unified big data platform (ETL layers)
Optimized, and implemented multiple models for the E-commerce customer using AWS Sagemaker in my role as a Data Scientist.Critical thinker to address customer support issues quickly and consistently exceeds performance standards
Built a robust framework that successfully synchronized data from diverse systems into a centralized snowflake database
Analysis of the gathered requirements, time estimation to complete the Data modelling, task, preparation of design documents, design reviews with manager as well as clients, Unit test case document preparation, development, testing and deployment of the application as per project planning
Supervised a team of eight professionals in the seamless migration of an e-commerce vendor's application from a traditional Data center to the cutting-edge AWS platform.
Data Engineer
12.2020 - 06.2022
Developed Python applications to bring the data in-house which was hold by third parties
Developed BODS jobs to bring the One-time history data to local DB and update the existing data as well
Co-ordinated with POWER BI resource to supply the Summary tables that will be used to create reports
Developed very few POWER BI reports.
Data Engineer
10.2018 - 12.2020
Writing Infra structure as a code using AWS Cloud Formation and Terraform
Developed PySpark jobs to stream the input data from various sources into S3 buckets
Using Data Ingestion techniques like AWS Kinesis firehouse, AWS Kinesis data streaming to stream the input data
Developing machine learning model for product suggestions to customer
Deployed the developed machine learning model using End Point.
Data Engineer
05.2018 - 09.2018
Bulit, maintained, scaled and supported 10+ existing data pipelines
Maintained the data well across the ETL layers
Managed updates for 15+ channels with improvements without disrupting the ongoing operations
Integrated 6 pipelines to feed data to machine learning models.
Data Engineer
12.2017 - 05.2018
Spearheaded the design and implementation of a secure environment for data assets, increasing authorized access to sensitive data by 70%
Streamlined data integration, profiling, and validation for various datasets by 40%, improving customer outcomes
Automated monthly data purge processes through snowflake data lake, resulting in decreased storage costs of 25%.
Senior Support Analyst
09.2015 - 11.2017
Providing support in Finance applications which heart of the Finance RETURNS area of the US based Cosmetic Company that was developed in Mainframe
As a single person providing 24X7 support for the application that I Supporting
In Parallel, lead a team of 5 members to provide L1 support for a stringent SLA where in need of paying penalty if we miss a resolution and response SLA for a single ticket
Overall SLA is also maintained by our team only
Awarded as an 'Associate of the Year' for 2016 where there was no Penalty paid to customer for the entire year for all the application that we supported
Presented an Innovation in Mainframe and process in an organization level where we showed a savings of 20K$ per month in the overall
Overall project management is handled by me which includes Delivery, Support process compliance, SNOW tool management, people management, invoice management, Audits, time sheet maintenance etc.
Support Analyst
12.2011 - 08.2015
Provided support in Finance application which heart of the US based Cosmetic Company that I was supporting
As a single person provided 24X7 support for the application that I Supported
Parallel was worked in development of the Supply chain java application from the same company that I used to support
Awarded as an 'Associate of the Quarter' for Q3 - 2014
Additionally worked in many Innovation and Continual service improvements that could reduce the tickets and eliminate the manual efforts spent in testing the developed codes
Was the sole owner of ESA activities (managing people), Invoicing for customer, Facing Audits of the project at Organization level
Won many awards for Innovation for the savings that I gave to the customer.
Education
Bachelor of Technology in Information Technology -
Kongu Engineering College
01.2011
Diploma in Information Technology - undefined
Kongu Polytechnic College
01.2008
SSLC - undefined
Erode Hindu Kalvi Niliyam
01.2005
Skills
Domain Knowledge:
Financial Services
Supply Chain
Retail
Technical Skills:
Python Programming
ETL development
Data Modeling
Data Migration
Snowflake
Talend
Informatica
SAP BODS
Power BI (Basics)
Machine Learning
Certification
AWS Cloud Practitioner Certification
PG program in AI and Machine Learning, Warangal
Spark and Python for Big Data with PySpark Certification
AWS Data Analytics Specialty Certification
Awards
Associate of the Year, 2017
Associate of the Quarter, Q3 - 2014
Innovation Champ of the Quarter, Q2 - 2013
Hobbies
Reading Books
Listening Music
Playing Carrom
Languages
English
Full Professional
Tamil
Native or Bilingual
Timeline
Senior Data Engineer
Hexaware Technologies Ltd.
12.2020 - Current
Data Engineer
12.2020 - 06.2022
Data Engineer
10.2018 - 12.2020
Data Engineer
05.2018 - 09.2018
Data Engineer
12.2017 - 05.2018
Senior Support Analyst
09.2015 - 11.2017
Support Analyst
12.2011 - 08.2015
Bachelor of Technology in Information Technology -