DEEPAK PATEL SUPPA
San Antonio
Summary
Azure Data Engineer with hands-on experience delivering end-to-end cloud data solutions across batch and streaming pipelines. Skilled in designing scalable ETL processes using Azure Data Factory, Databricks, PySpark, and Azure SQL Database. Experienced in building metadata-driven frameworks, including streaming ingestion pipelines, data quality engines, and CDC-based Delta Lake processing. Strong background in integrating REST APIs, automating workflows with Azure Logic Apps, and optimizing data storage in Azure Blob Storage. Proven ability to implement schema validation, audit logging, quarantine processing, and enterprise-grade data governance. Adept at troubleshooting pipeline failures, enhancing performance, and ensuring data reliability across multi-client environments. Collaborative problem-solver with experience working closely with cross-functional teams to enable analytics, reporting, and operational insights.
Overview
1
1
year of professional experience
Work History
Azure Data Engineer
Y&L Consulting, Inc.
San Antonio
04.2025 - Current
- Develop, manage, and monitor end-to-end ETL pipelines using Azure Data Factory for automating data ingestion, transformation, and loading into Azure SQL Databases.
- Build and maintain scalable data transformation processes using Azure Databricks and PySpark for batch and streaming datasets.
- Create and manage Logic Apps for automating scheduled tasks, notifications, and service integrations across Azure platforms.
- Perform database development, optimization, and troubleshooting using SSMS to ensure data availability, integrity, and performance.
- Design and implement solutions on Azure Blob Storage for efficient storage of raw and processed datasets.
- Conduct root cause analysis and resolve issues related to data pipeline failures, delays, and performance bottlenecks.
- Collaborate with business and analytics teams to define data models and ensure timely availability of validated datasets.
- Implement data validation, error handling, and alerting mechanisms to maintain high data quality and operational reliability.
- Occasionally we integrate external REST APIs into data pipelines for real-time data enrichment and synchronization.
- Ensure compliance with data governance, security, and privacy standards across all Azure data solutions.
- Collaborated with team members through regular meetings and project discussions to ensure timely delivery of tasks and objectives.
Software Engineer
Keshav Consulting Solutions LLC
Suwanee
09.2024 - 03.2025
- Developed backend components and REST APIs for cloud-based applications using Java and Python, supporting secure and scalable data interactions.
- Assisted in the design and maintenance of ETL workflows to automate data ingestion into Azure SQL Database and Blob Storage.
- Supported application development tasks by integrating relational database MySQL with application front ends.
- Participated in designing cloud-based solutions using Microsoft Azure services, with a focus on data storage, retrieval, and system optimization.
- Wrote, optimized, and maintained SQL queries and stored procedures for application and reporting requirements.
- Collaborated with cross-functional teams to deliver scalable and maintainable application modules aligned with project goals.
- Followed software engineering best practices include version control, code reviews, and unit testing.
- Supported the deployment and troubleshooting of applications in development, staging, and production Azure environments.
Education
Master of Science - Computer Science
Campbellsville University
Louisville, KY, USABachelor of Technology - Computer Science and Engineering
Jawaharlal Nehru Technological University
Hyderabad, Telangana, IndiaSkills
Programming Languages:
- Python
- Java
- SQL
Big Data & Processing:
- PySpark
- Delta Lake
Cloud & Data Engineering:
- Azure Databricks
- Azure Data Factory (ADF)
- Azure Blob Storage
- Azure Logic Apps
- Azure SQL database
- Azure Log Analytics
- Databricks Auto Loader
Databases:
- SQL Server
- MySQL
- PostgreSQL
Integration & APIs:
- REST APIs
Version Control & DevOps:
- Git
- Azure DevOps
Tools:
- SSMS
- Power BI
Timeline
Azure Data Engineer
Y&L Consulting, Inc.
04.2025 - Current
Software Engineer
Keshav Consulting Solutions LLC
09.2024 - 03.2025
Master of Science - Computer Science
Campbellsville University
Bachelor of Technology - Computer Science and Engineering
Jawaharlal Nehru Technological University