Dinesh Saraswat
Walnut Creek,CA
Summary
Experienced Data Engineer with 11 years in the field, currently pursuing an MS in Business Analytics. Proven expertise in Data Warehouse, ETL processes, SQL, Netezza, PySPARK, HIVE, Impala, Airflow, UNIX, Oracle, Teradata, Business Analysis, Data Analysis, MS Office, Splunk, AWS Glue, Amazon Redshift, Hadoop, Docker, Kubernetes, and other cloud and big data technologies. Adept at managing and optimizing data systems for efficiency and accuracy. Excited about integrating technical skills with business insights gained from ongoing academic pursuits. Seeking opportunities in Senior Data Engineer roles at AWS or Meta to leverage my comprehensive skill set and contribute to cutting-edge data solutions.
Overview
11
11
years of professional experience
Work History
Senior Software Engineer/Senior Data Engineer
MasterCard
Pune India
09.2019 - 10.2022
- Spark ETL Migration:Led the migration of ETL code to Spark, optimizing data loads and reducing costs.
- Data Compliance Overhaul:Updated ETL code for swift compliance with data localization laws.
- Legacy Data Backloading to Hadoop:Efficiently moved data from legacy databases to Hadoop, fixing character code issues.
- Quarterly Data Pipeline Updates:Managed regular updates to the data pipeline, aligning it with changing business needs.
Senior Consultant
Exusia
Pune India
02.2017 - 09.2019
- Report Performance Optimization: Streamlined code and converted views to stored procedures, reducing report refresh time from 5 hours to under 6 minutes.
- Stale Delete Fix: Resolved stale delete issues in key dimensional tables through data analysis.
- ETL Rules Definition: Interacted with business to define ETL and code rules.
- Training and Onboarding: Conducted SQL and DWH tech stack training for new employees.
Senior Consultant
Datametica
Pune India
07.2016 - 01.2017
- Correlation Analysis for Sales:Conducted correlation analysis between weather, local events, and sales of product categories at local stores.
- Data Quality Enhancement:Identified and addressed data quality issues in the transaction sales table at Kohl's, implementing effective solutions.
Associate Consultant Technology
ZS associates
06.2013 - 07.2016
- End-to-End Data Warehouse Projects: Led comprehensive data warehouse projects for clients including American Airlines, US Airways, Depuy Synthes, Gilead, Alere, and Galderma.
- Automated Unit Testing and Development: Automated unit testing and development for the Landing layer of data processing, significantly cutting development time from one week to a few hours.
- CMMI Level-3 Compliance: Contributed to the establishment of projects for inclusion in CMMI Level-3 compliance at the organizational level.
Project Engineer
Wipro Technologies
Bangalore India
10.2011 - 05.2013
- ETL and DWH Best Practices Implementation:Acquired and applied ETL and Data Warehouse best practices, implementing them successfully on projects with Target retail.
- Exemplary Team Contributor:Contributed to the best-performing team within the Data and Analytics Business Unit at Wipro.
Education
Master of Science - Business Analytics
California State University - East Bay
Hayward, CA12.2024
Bachelor of Engineering - Computer Science and Engineering
Oriental Institute of Science And Tech
Bhopal India05.2011
Skills
Programming Languages:
Python
Big Data Technologies:
Apache Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, HBase)
Apache Spark
Cloud Services:
AWS (Amazon Web Services):
Amazon EMR
Amazon S3
Amazon Redshift
AWS Glue
Database Systems:
SQL
Relational databases - Netezza, Oracle, Teradata, DB2, HIVE and Impala
NoSQL databases - HBASE
ETL (Extract, Transform, Load):
AWS Glue
Informatica
DataStage
Containerization and Orchestration:
Docker
Streaming Data Processing:
Apache Kafka
Spark Streaming
Data Warehousing:
Amazon Redshift
Data Modeling:
Designing and implementing data models
Security and Compliance:
Data security best practices
Encryption
Compliance requirements
Data Mining:
Knowledge of data mining techniques and tools
Data Analysis:
Proficient in data analysis methods
Tools such as Pandas, NumPy, Seaborn and Matplotlib or equivalent
Collaboration and Communication:
Strong communication skills
Problem-Solving and Troubleshooting:
Identifying and solving complex data engineering challenges
Version Control:
Git
Automation and Scripting:
Bash
Python
Continuous Learning:
Staying updated on emerging technologies and industry trends
Agile Methodology:
Experience working in an Agile/Scrum development environment
Timeline
Senior Software Engineer/Senior Data Engineer
MasterCard
09.2019 - 10.2022
Senior Consultant
Exusia
02.2017 - 09.2019
Senior Consultant
Datametica
07.2016 - 01.2017
Associate Consultant Technology
ZS associates
06.2013 - 07.2016
Project Engineer
Wipro Technologies
10.2011 - 05.2013
Master of Science - Business Analytics
California State University - East Bay
Bachelor of Engineering - Computer Science and Engineering
Oriental Institute of Science And Tech