Senior engineering professional with deep expertise in data architecture, pipeline development, and big data technologies. Proven track record in optimizing data workflows, enhancing system efficiency, and driving business intelligence initiatives. Strong collaborator, adaptable to evolving project demands, with focus on delivering impactful results through teamwork, innovation and with strategic approach to data management and problem-solving.
Work History
Senior Data Engineer
3 Years 2 Months
The Martin Brower LLC | 04.2023 - Current
Worked as a Sr Software Engineer Data Engineer in below project. These projects are performed in Agile methodology
Brief description of the projects:
This Project is to build Datalake for the Mcdonald's Data. Extracting all the data and maintaining the source of truth of all the data and provisioning it to various target systems is the goal of the project. This project is to implement/make centralized data for the McDonald's sales data, items data for all the markets over the globe using ADF. Extract the data from various sources and perform transformations and load the data into data lake and this is loaded to the Snowflake . Also loading File based data from FTP servers into data lake.
Fetch the data saved in the Snowflake and provide access to the business analysts. Till now we were able to process data from more than 40 Huge Source systems.
As a Data Engineer
Extracting the Data from various source systems(SQL Server, Oracle) into the Datalake using ADF into Snowflake
Designed pipelines in ADF to extract data from various sources like Oracle, SQL Server and load the data into Datalake.
Transformations on data using Dataflow components which includes Business rules, Filtering and Standardization to build certified layer on the raw data for analytics purpose.
Day to day pipeline monitoring to optimise the pipelines and creating alert rules for pipeline failures.
Managing Integration Runtime servers.
Helping support team fixing the pipeline issues and managing link services datasets e.t.c.
Helping users to archive old data that’s not been actively used by the users.
Preparing run books for the major deployments.
Coordinating with Devops team in release management and helping team in reviewing the code and approving pull request and involving in POST Production support.
Managing injection logs in Snowflake tables.
Data validation scenarios to ensure the data quality between source and target.
Production support Engineer
5 Years 10 Months
Apple | 06.2017 - 04.2023
Worked as a Production support Engineer in below project.
Brief description of the projects:
Repair Central & MobileGenius are the apple applications which are used in Apple retail stores globally. These applications are Apple Enterprise applications and used to create repair for the apple products and provide their services for Apple products.
As a Support Engineer
Code debugging and providing code fixes to development team.
Monitoring application health and setting up alerts.
Working on Root cause analysis for the issues raised by application users and business team.
Working on Incidents raised by application users.
Handling Linux host patching.
Involved in multiple activities like deployments and DB patching by coordinating with respective teams.
Junior Developer
2 Years 9 Months
Hidden Brains Infotech | 06.2014 - 03.2017
App Bevy :
It is an e-commerce application for trading refreshments like Alcohol, beer, cigarettes, etc. This is a clone application consisting customer and driver (two apps).
Responsibilities:
Implemented UI design and implemented functionality as per requirements.
Apple Maps integration, GPS functionality to determine tagged locations of customer and driver and store.
Using Geocoding Location Data and Reverse Geocoding Location Data.