Priyanka Shelar
Somerset
Summary
Lead Data Engineer | Data Pipeline Development | Cloud Analytics Solutions | Team Leadership
Insightful Technical Lead with 12+ years of Engineering experience. Proficient in pipelines, data modelling, optimizing and scripting. Motivated professional positively impacting projects through detail and skilled designs.
Overview
13
13
years of professional experience
Work History
Lead Data Engineer
Analytic Partners
New York
01.2023 - 03.2023
- Leading team of Engineers to develop and support new data platform/products that offer data ingestion, quick processing of complex modeling, and deep insights through data visualizations
- The products benefit distinct clients in multiple ways such as business intelligence analysis, scenario, and media planning, as well as budget and ROI optimization
- Collaborate with Marketing Analyst, Product Managers to improvise products for commercial Intelligence that helps to understand/unlock brand impact
- Develop and support cloud-based analytics products for Commercial Decisioning, that helps different clients to defend marketing and media budgets, navigate uncertainty, and future-proof plans using analyticsLed full lifecycle of data solutions—from ingestion and transformation to dashboard delivery and business consumption
- Led full lifecycle of data solutions—from ingestion and transformation to dashboard delivery and business consumption
Data Engineer Intern
Amazon Robotics
Boston, MA
05.2022 - 08.2022
- Designed and develop Data lineage solution (using AWS services) for the ORBIT (Optimized Robotics Business Insights and Tools) team that provides the infrastructure, services and tools that enable business intelligence engineers, data scientist and other fellow roboticists to make insights from data to drive decisions
- Developed CLI based tool and cost-effective solution
- Widely used by Orbit and its customers
Data Engineering Specialist
Johnson & Johnson
Bridgewater, NJ
06.2018 - 06.2021
- Designed and developed technical solution for building CDC (change data capture) framework to stream data changes happening in heterogenous ERP's like JD system, SAP Systems and load data as is from source ERP to Enterprise Data Grid near real time, with high utilization and productivity gains
- Designed and implemented the CDC (change data capture solution) where more than 45 TB data gets pumped into the target grid on monthly basis with a throughput of ~18K record/second changes streamed into the Grid or Target system
- Implemented automation for Informatica Mapping and workflow development process using Python and reduced the code development time by 90%
- Automated CDC jobs and alert mechanism for 24/7 running CDC jobs through Unix scripting in case of any job's failure
- Improved the monitoring effort of real time CDC jobs by 85% to avoid any data gaps between source ERP data and Target system data
- Designed and developed ETL batch jobs in case the Source ERP System is not supportive for real time CDC solution
Technical Lead DWH & Analytics
ResMed
San Diego, CA
07.2016 - 05.2018
- Led the Healthcare Informatics team at ResMed (Global leader in sleep apnea device manufacturing and respiratory devices)
- Analyzed Advanced analytic objectives and built full stack Healthcare Analytics Product that allowed HMEs to view patient analytics and compliance rates for their patient population
- The application allowed the customers to view patients that were at risk of not meeting compliance with 95% accuracy
- Designed and Implemented 100% metadata driven object oriented ETL engine to capture Patient's sleep and respiratory improvements
- It helped the Clinical Staff Team to understand patient's health improvements generating a revenue of more than 2 Mil
- Involved in design and development of HI Dashboard in tableau showing different statics related to Patient Data
Senior ETL Developer
Larsen & Toubro Infotech
India
02.2015 - 06.2016
- Monitored and minimized Informatica job run time in existing long running sessions and automated the workflow to avoid manual intervention during production run which almost saved 25% of the job run time
- Development experience in No SQL databases like HBase
- Strong SQL skills to build custom datasets for analysis and reporting
- Designed and implemented daily load and reconciliation of large data source using combination of shell scripts and stored procedures
Software Engineer
Wipro Technologies
Pune India
07.2010 - 01.2015
- Created ETL jobs to pull data from diverse sources and transform and load into using tools like Informatica PowerCenter
- Enhanced Informatica jobs and SQL queries of data load/ingestion process to triple the load handling capacity
- Monitored long running SQL queries and made changes to reduce their run times by about 50%
- Handled SCD type -1 and type -2 dimensions using Informatica
- Improved efficiency by 25% by automating processes to handle ad-hoc file request through shell scripting, reducing manual effort by 2 hrs. per request
- Proven expertise in building self-service data platforms for BI and Data visualization
Education
Master of Science - Computer Science
New York University, Tandon School of Engineering
New York, NYMaster of Science - Software Engineering
BITS PILANI, Birla Institute of Technology And Science
IndiaBachelor of Science - Information Technology
SIES College, Mumbai University
IndiaSkills
- Programming Languages – Python, Java, pyspark
- Databases - Oracle,Teradata,MS SQL Server
- Big Data Ecosystem - Hive ,Impala ,Confluent Kafka Delta Lake
- Cloud Stack - AWS -Lambda , S3 ,Glue, Athena,Dynamo DB, Step functions, Cloud Formation
- Cloud Stack - Azure data factory, Azure data Lake Store, Azure synapse
- ETL and BI skills - Informatica PowerCenter 8x, 9x ,10x ,Informatica Power exchange 96,101,102 and 104 , Informatica MDM , Power BI , Cognos, SAP BO
Accomplishments
- Data Lineage Solution
- Python Automation Efficiency
- Efficiency Improvement
- Healthcare Analytics Success
- Key Impact
Developed data lineage solution used by over 500 Orbit users monthly.
Reduced code development time by 90% through Python automation.
Improved job run efficiency by 25% and reduced hours per request.
Generated over $2 million revenue with healthcare analytics product.
Drove scalable, Azure-based data ingestion and visualization solutions that improved reliability, accelerated decision-making, and enabled business stakeholders to act faster
Timeline
Lead Data Engineer
Analytic Partners
01.2023 - 03.2023
Data Engineer Intern
Amazon Robotics
05.2022 - 08.2022
Data Engineering Specialist
Johnson & Johnson
06.2018 - 06.2021
Technical Lead DWH & Analytics
ResMed
07.2016 - 05.2018
Senior ETL Developer
Larsen & Toubro Infotech
02.2015 - 06.2016
Software Engineer
Wipro Technologies
07.2010 - 01.2015
Master of Science - Computer Science
New York University, Tandon School of Engineering
Master of Science - Software Engineering
BITS PILANI, Birla Institute of Technology And Science
Bachelor of Science - Information Technology
SIES College, Mumbai University