Ankur Mishra
Hill,NH
Work Preference
Summary
Azure Certified Data Engineer with over 15 years of comprehensive IT experience, including 5 years focused on designing and implementing robust end-to-end ETL data solutions on Microsoft Azure. Proficient in building scalable data pipelines, orchestrating complex ETL/ELT workflows, and managing data lake and warehouse architectures using Azure services such as Data Factory, Databricks, and Data Lake Storage. Extensive expertise in real-time data processing with Spark Streaming in Databricks, along with a strong background in developing end-to-end data flow applications using PySpark, Python, and Spark SQL. Excellent communication skills complemented by a proactive, team-oriented approach and over 8 years of onsite experience collaborating closely with clients to deliver tailored cloud-based solutions. Meticulous [Job Title] maintaining highly functional digital systems for uninterrupted workflows and consistent productivity. Oversees routine maintenance checks and software update schedules to reduce network downtime and likelihood of security compromises. Loves collaborating with customers and teammates to develop and implement creative technical solutions to challenging problems.
Overview
1
1
Certification
16
16
years of professional experience
Work History
Azure Data Engineer
Amerihealth Caritas – Fee Schedule Management
03.2025 - Current
- ensuring alignment with business objectives.
- Authored and maintained data rule books; facilitated reviews and sign-offs with business and IT teams.
- Contributed to solution architecture, data modeling, and technical design; presented designs to stakeholders.
- Designed and developed scalable data ingestion pipelines using Azure Data Factory and Azure Databricks.
- Implemented centralized data governance using Unity Catalog across multiple Databricks workspaces in collaboration with platform admins.
- Created catalogs, schemas, and tables; led migration of Synapse tables to Unity Catalog-enabled Delta tables.
- Integrated and transformed structured and semi-structured data from diverse sources and formats.
- Applied Medallion Architecture (Bronze, Silver, Gold layers) to build efficient and reliable data pipelines.
- Developed PySpark and Spark SQL applications in Databricks for large-scale data processing, aggregation, and reporting.
- Built complex SQL queries and stored procedures; integrated with ADF to implement Change Data Capture (CDC) on curated data layers.
- Implemented CI/CD pipelines using Azure DevOps to support automated Build–Test–UAT–Production deployments.
- Troubleshot and resolved production issues, ensuring high availability and reliability of data pipelines.
- Delivered enhancements and performance optimizations for existing data applications in production environments.
Azure Data Engineer
Walgreens - Campaign Management System
04.2021 - 03.2025
- Collaborated with business users to gather requirements and design a common enterprise data architecture for retail data; built scalable data lake solutions on Azure.
- Analyzed existing production systems and designed modern data solutions using Azure PaaS services aligned with current business processes.
- Led architecture design, data modeling, and technical solutioning; conducted design walkthroughs with stakeholders.
- Defined project scope, strategy, and effort estimates; communicated timelines, deliverables, and milestones to stakeholders.
- Recommended architectural improvements and integration strategies to optimize cost and performance.
- Designed and implemented ETL pipelines using Azure Data Factory to ingest data from multiple source systems into Azure Data Lake.
- Processed and transformed data using ADF Mapping Data Flows and Azure Databricks (PySpark, Spark SQL); loaded curated data into Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
- Implemented Unity Catalog in Databricks for centralized data governance across multiple workspaces in collaboration with platform admins.
- Created catalogs, schemas, and tables; migrated Synapse tables to Unity Catalog-enabled Delta tables.
- Developed PySpark and Spark SQL applications for large-scale data transformation, aggregation, and consumption-ready datasets.
- Built real-time data processing pipelines using Azure Event Hubs and Databricks to ingest and process streaming customer transaction data.
- Developed complex SQL queries and stored procedures; integrated with ADF pipelines to implement Change Data Capture (CDC).
- Established CI/CD pipelines using Azure DevOps for automated Build–Test–UAT–Deployment processes.
- Monitored applications and ensured 24/7 production support readiness for critical data systems.
- Resolved production issues and delivered enhancements to improve system stability and performance.
- Conducted regular stakeholder meetings and published weekly/monthly status reports on project progress and deliverables.
ETL Architect | Lead Developer
Walgreens - CSO: Ab Initio to Talend Migration
06.2019 - 03.2021
- Understand current application built on Abinitio platform and list down all the modules/jobs which are to be migrated to Talend.
- Prepare sprint wise project plan and divide the jobs into multiple modules which are to be migrated from Ab Initio to Talend DI and Big Data platform.
- Work on effort and time estimation of each module consisting of Ab Initio jobs which are going to be converted in Talend DI and Bigdata platform.
- Develop complex ETL jobs using Talend Open Studio Data Integration and Big data tool.
- Build & test Talend ETL jobs and compare the test results with respective Ab Initio jobs.
- Build reusable master scripts using Unix shell scripting and integrate with Talend ETL jobs.
- Build large scale complex SQL queries and integrate with Talend Big data jobs using sql components.
- Configure Talend big data jobs to integrate with Hsadoop cluster.
- Configure master Ab Initio job to compare output result with those of Talend jobs.
- Conduct UAT meetings and walkthrough module wise and plan to deploy Talend jobs in parallel environment.
- Help in performance tuning of long running Talend Jobs.
- Build the cut off plan to deploy Talend modules in production and then compare the results with Ab Initio. Then finally shutting off Ab Initio modules.
- Monitor the application and enable the team to provide 24/7 production support.
- Implement fixes and enhance the existing application through change requests.
AS 400 Dev & RunOps Lead
Walgreens – Logistics Systems: Ordering Processing, Billing & Shipping
01.2017 - 05.2019
- Gathered detailed business requirements and translated them into technical design documents aligned with project needs.
- Analyzed existing system architecture and mapped business requirements to appropriate technical modules.
- Performed impact analysis to identify affected components and ensure comprehensive solution design.
- Coordinated in an Onshore-Offshore delivery model, effectively communicating business and technical requirements across teams.
- Prepared effort estimates, defined delivery timelines, and developed detailed project plans in collaboration with stakeholders.
- Developed and maintained AS400 applications using Synon, RPG, and Control Language (CL).
- Conducted unit testing, system integration testing, and supported UAT cycles with business users.
- Led code reviews and facilitated UAT walkthroughs and business sign-off sessions.
- Developed complex SQL queries and stored procedures in DB2 environments.
- Conducted regular status meetings and provided updates on project progress to stakeholders.
- Provided production support, including enhancements and bug fixes for existing applications.
- Monitored critical batch jobs to ensure seamless processing of store orders, billing, and shipping operations.
- Troubleshot production issues, performed root cause analysis (RCA), and implemented fixes for recurring failures.
- Created Standard Operating Procedures (SOPs) for business and RunOps teams to ensure smooth operational workflows.
Senior AS400 Developer
Walgreens – Store & DC Ordering: JDA Implementation
08.2014 - 12.2016
- Interact with business stake holders and SMEs to understand current legacy ordering system built over legacy AS400 architecture.
- Involve in data mapping brainstorming sessions and identify the master data from legacy source system (DB2 database).
- Perform impact analysis on the existing system to make sure all the impacted components are covered in the design document.
- Work with ETL Abinitio teams to understand the master data requirement and work on mapping the requirements to the master data tables in legacy AS400 system.
- Build new AS400 applications to fulfill master data requirement to be sent to Centralized JDA system through ETL layer.
- Integrate existing AS400 applications with new source of data coming from centralized ordering system from JDA.
- Work in Onshore-Offshore model and convey the business and technical requirements to the team.
- Conduct weekly status meeting with project stakeholders reviewing the progress of the projects.
- Participate in war room meetings during deployment phase as an AS400 SME and mitigate production issues found during deployment phases.
- Provide production support post deployment and monitor the application. Do enhancements and bug fixes in existing applications.
- Monitor critical applications in production and make sure smooth processing of daily store orders to vendors and Walgreens distribution centers.
- Create handbooks and do the knowledge transfer to the RunOps team.
AS400 Developer
Walgreens – Store Inventory Management System
06.2010 - 07.2014
- Participate in business meetings to understand and gather the requirements.
- Understand the current system and map the requirements to the impacted applications.
- Perform impact analysis on the existing system to make sure all the impacted components are covered in the design document.
- Create high level design documents and perform walkthrough meetings with business and get the signoff.
- Create technical design document with all the impacted components and get the peer review done.
- Develop the applications in AS00/Synon and do the unit testing.
- Perform system testing and work with QA team to perform quality assurance review.
- Facilitate code walkthrough and assist in user acceptance testing along with onsite team.
- Monitor critical applications and provide production support.
- Perform root cause analysis for job failures and implement permanent fixes.
- Monitor day to day incidents through BMC Remedy incident management tool.
Education
Bachelor of Science - Xs
Af
Asd01.2036
Bachelor of Technology - Computer Science & Engineering
Madan Mohan Malviya Engineering College
Skills
- Teamwork
- Teamwork and collaboration
- Problem-solving
- Time management
- Patient monitoring
Additional Information
sdcw
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Certification
- Databricks Certified Data Engineer Associate
- Databricks Certified Spark Developer Associate
- Microsoft Certified Azure Data Engineer (DP-203)
- Databricks Accredited Lakehouse Fundamentals
Timeline
Azure Data Engineer
Amerihealth Caritas – Fee Schedule Management
03.2025 - Current
Azure Data Engineer
Walgreens - Campaign Management System
04.2021 - 03.2025
ETL Architect | Lead Developer
Walgreens - CSO: Ab Initio to Talend Migration
06.2019 - 03.2021
AS 400 Dev & RunOps Lead
Walgreens – Logistics Systems: Ordering Processing, Billing & Shipping
01.2017 - 05.2019
Senior AS400 Developer
Walgreens – Store & DC Ordering: JDA Implementation
08.2014 - 12.2016
AS400 Developer
Walgreens – Store Inventory Management System
06.2010 - 07.2014
Bachelor of Science - Xs
Af
Bachelor of Technology - Computer Science & Engineering
Madan Mohan Malviya Engineering College