Mamatha Margam
Summary
Over 7 years of experience as a Data Engineer and ETL Developer. Expertise in Big Data technologies, Hadoop ecosystem, and cloud services. Strong background in designing, developing, and implementing data models for enterprise applications. Skilled in Agile/SCRUM methodologies and the full SDLC process. Proficient in a wide range of tools and technologies for data engineering, including Spark, Hive, AWS, and Azure.
Overview
8
8
years of professional experience
1
1
Certification
Work History
Data Engineer
Nationwide
Columbus, OH
06.2023 - Current
- Created and managed pipelines in ADF for ETL processes
- Utilized Azure Data Storage services and implemented Spark SQL queries
- Worked extensively with Azure SQL Data Warehouse, Azure ML, and various Azure services
- Implemented dynamic partitioning and bucketing in Hive
- Migrated data from Teradata to Snowflake and created Snowpipe for continuous data load
- Developed CI/CD pipelines in Azure.
Data Engineer
Express Script
Morris, Planis
02.2022 - 06.2023
- Managed ETL pipelines using AWS services such as S3, EC2, EMR, and Redshift
- Migrated HDFS data to AWS cloud and developed Python scripts for ETL processes
- Worked with NoSQL databases and developed Spark applications
- Automated data workflows using Apache Airflow.
Big Data Engineer
DXC Technology
India, India
05.2019 - 04.2022
- Developed data-driven solutions using Python and Spark
- Implemented data warehouse structures and optimized Spark applications
- Developed Talend Big Data jobs and integrated Apache Airflow with AWS
- Extracted and transformed data using various Hadoop tools.
ETL Developer
CAT Technologies
India, India
07.2016 - 04.2019
- Designed and developed ETL programs using Informatica
- Implemented performance tuning and utilized shell scripts for ETL processing
- Developed Spark jobs and performed data ingestion to Azure services
- Created efficient SQL programs and automated Sqoop incremental imports.
Education
MS in Business Analytics -
Saint Peter's University
11.2023
Skills
Big Data Ecosystems
- Hadoop (MapReduce, HDFS)
- Spark
- Kafka
- Hive
- HBase
- MySQL, PostgreSQL, MongoDB
- Python, SQL, Java
- AWS, Azure
- Cloudera
- GIT, Maven, Jenkins
- Agile, Scrum
- Unix/Linux, Windows
Certification
- AWS Certified Solutions Architect
- Azure Data Engineer Associate
- Certified Scrum Master (CSM)
Timeline
Data Engineer
Nationwide
06.2023 - Current
Data Engineer
Express Script
02.2022 - 06.2023
Big Data Engineer
DXC Technology
05.2019 - 04.2022
ETL Developer
CAT Technologies
07.2016 - 04.2019
MS in Business Analytics -
Saint Peter's University