Highly skilled Lead Data Engineer with solid experience in designing, implementing, and maintaining data pipelines.
Strong proficiency in Python, SQL. Known for improving system efficiency by optimizing data processing algorithms.
Successfully led cross-functional teams to drive project completion within deadlines.
Practical database engineer possessing in-depth knowledge of data manipulation techniques and computer programming paired with expertise in integrating and implementing new software packages and new products into system.
Offering several-year background managing various aspects of development, design and delivery of database solutions.
Tech-savvy and independent professional bringing outstanding communication and organizational abilities.
Overview
18
18
years of professional experience
1
1
Certification
Work History
Lead Data Engineer
EPSILON DATA MANAGEMENT LLC
USA
09.2020 - Current
Worked with various internal teams to get their requirement and use cases for anomaly detection and alerting through various channels email, Jira, Pagerduty, Microsoft Teams
Built ETL pipeline that ingested transactional data from Oracle database to Elasticsearch to have data anomalies and create alerts
Supported implementation and active monitoring of airflow jobs
Developed python program to read outlook emails and store the contents and attachments into database
Purging transactional tables in Oracle database
Designed and developed a generic Oracle package to create OLTP database to retain only specific number of months and also partitioning the tables from the existing hub database
Migrated Hadoop - Impala database to Oracle
Fine tuned several SQL queries to reduce the execution time
Developed solution in Oracle for a MVP to load huge volume of file data to tables where the team was stuck with the performance issues with Informatica
Developed various dashboards using Elasticsearch - Kibana visualization.
Data Engineer
KUMARAN SYSTEMS INC
USA
09.2014 - 09.2020
Developed Python code for deploying DB changes to non-prod/prod databases
Developed generic framework using Python for data synchronization between two different Oracle databases
Developed generic framework to shred XML data into Oracle tables using Oracle PLSQL and shell scripting
Migrated SQR code to SAP - ETL: Business Objects Data Services
Analyzing business requirement, creating mapping and technical documentation
Database development changes for ongoing projects
Designing ETL job using Data Services as per requirement
Tuning the oracle queries to enhance the performance of application
Developed database objects as per requirement and created database build for deployment to test environments and production environment
Onsite technical lead for Offshore data team.
Assistant Project Manager
KUMARAN SYSTEMS
Chennai, India
05.2010 - 09.2014
Database development changes for ongoing projects
Designing ETL job using Data Services as per requirement
Tuning the oracle queries to enhance the performance of application
Developed oracle objects as per requirement and created database build for deployment to test environments and production environment
Written shell script to identify and fixing invalid objects across all testing environments
Consolidated two separate databases which are used for different applications into One database
Data encryption/decryption in Oracle to secure the confidential data
Configuring / analyzing and fixing issues in Shareplex for replicating data between databases
Played a vital role to support onsite team
Offshore team lead.
Senior Technical Analyst
3i Infotech Sdn Bhd
Kuala Lumpur, Malaysia
01.2007 - 03.2010
Built reusable codes & generic components
Developed various Codes with Oracle Packages, Functions & Procedures to incorporate the business logic into the application
Analyzing queries and enhanced Query performance by taking advantage of Oracle indexing features
Gathered system requirements from the client
Proposed efficient system logic to the client
Worked closely with client to research and resolve user testing issues and bugs
Handled a team, guiding them in developing codes & logic as per the business requirement
Liaise with BA's to provide testing cases as per the Business Requirement Document.
Education
Professional Certification in Machine Learning And Artificial Intelligence -
UC Berkley HAAS
Master of Science in Information Technology -
Annamalai University
India
Bachelor Degree in Business Administration -
Madras University
India
Diploma in Computer Technology -
State Board Education
India
Skills
Python
SQL
PL/SQL
Shell scripting
Data Modeling
Designing and building dimensions and cubes with star schema and snowflake schema
Renewal Operations Analyst at Rubrik India Private Limited (Cloud Data Management – Data & Cyber Security)Renewal Operations Analyst at Rubrik India Private Limited (Cloud Data Management – Data & Cyber Security)