Data Engineer with 5+ years of experience in software engineering, leveraging strong interpersonal and communication skills. Seeking to enhance professional experience and establish credibility within an organization.
Overview
6
6
years of professional experience
Work History
Data Engineer
Texas Instruments
Frisco, TX
01.2024 - 07.2024
Have Extensive Experience in IT data analytics projects, Hands on experience in migrating on premise ETL's like datastage to DBT.
Developed Snowflake models and handled data cleansing, Slowly Changing Dimension models, surrogate key assignment and changed data captures.
Built pipelines to copy data from source to destination in Data Build Tool.
Worked on creating Data orchestration pipelines for copy activity, moving and transforming data for On-cloud ELT Processing.
Created automated workflows and scheduled jobs in Control M and DBT.
Exposure in using Hadoop ecosystem components like HDFS, YARN, MapReduce, Hive, Pig, Sqoop, HBase, Spark, SparkSQL, Kafka, Spark Streaming and Hue.
Used SnowSQL to execute SQL queries and perform all DDL and DML operations, including loading data into and unloading data out of database tables.
Used DDL and DML for writing triggers, stored procedures, and data manipulation in Snowflake.
Initiated and led Performance tuning for slow running stored procedures and redesigning indexes and tables.
Used various validation techniques to validate data between different environments after deployment to ensure Data is in sync among DEV, QA and PROD .
Established frequency of data, data granularity, data loading strategy.
Used DBT to update and deploy Pipelines within various environments (DEV, QA, PROD) using YAML Files and Git Repository
Sr Data Analyst
Techorbit Inc
02.2020 - 11.2022
Demonstrated expertise in implementing ETL processes using Pentaho 7.x.
Developed and maintained ETL processes using Pentaho.
Developed business logic for data transformation and customization in Pentaho data integration, resulting in accurate and organized presentation of Incentives information.
Implemented and documented automation of 401k process, incorporating multiple sources of benefits from relational and non-relational databases along with complex formula manipulation in ETL and JavaScript transformation.
Facilitated cross-functional collaboration to enhance data pipeline efficiencies, resulting in a 70% increase in team productivity and reduced project timelines by 30%
Participated in the migration from payroll to Workday system by actively contributing to process development using MYSQL and Pentaho Data Integration.
Streamlined and delivered multiple project modules on time.
Actively participated in all project discovery and requirement gathering meetings.
Conducted research in alternative data storage solutions, such as Oracle.
Developed a comprehensive debugging mechanism for client specific issues, enabling efficient problem identification and resolution at all processing levels.
Collaborated with devops team to seamlessly integrate systems and deploy solutions to various environments.
Refactored ETL processes to optimize performance and eliminate bottlenecks.
Collaborated with cross-functional team members to develop and maintain efficient ETL solutions through creation of various transformations and jobs.
Organized training sessions where I explained all steps, transformations and jobs utilized in Pentaho Data Integration.
Documented and tested processes at each stage of development.
Implemented Power BI reports for analysis
Data Analyst
InsertV Consultancy Services
08.2018 - 08.2020
Implemented Agile processes in order to align procedures with the software development lifecycle. Contributed to the Informatica Upgrade team, successfully migrating all applications from version 10.1 to 10.2.
Migrated critical applications such as Digital, Linear, DSA, and DST.
Overseen testing of all workflows and mappings in versions 10.1 and 10.2, ensuring performance validation.
Utilized the DVO tool to test and ensure accuracy of data loading in multiple environments.
Developed proficiency and enhanced knowledge of Salesforce while working towards targets.
Delivered quality deliverables successfully on time, receiving appreciation from application team and managers.
Designed and implemented end-to-end ETL architecture, seamlessly transforming requirements into deliverables.
Assisted in gathering requirements and creating project roadmaps for high-level estimates and product delivery.
Expert in deploying Informatica data center products utilizing manual, archive, and installer methods.
Participated in Business Analysis and requirement collection.
Interacted with clients, business users, and various teams to gather information for requirement specification documents.
Interacted with business users and team managers to maintain up-to-date status and gather requirements/change requests.
Collaborated closely with Project Managers and Product Management to gain deep insights into ETL and reporting solution requirements.