Summary
Overview
Work History
Education
Skills
Timeline
Generic

DEEPAK PATEL SUPPA

San Antonio,TX, USA

Summary

Azure Data Engineer with hands-on experience building end-to-end cloud data solutions for batch and streaming pipelines. Skilled in designing scalable ETL workflows using Azure Data Factory, Databricks, PySpark, and Azure SQL Database. Experienced in creating metadata-driven frameworks, streaming ingestion, data quality checks, and CDC-based Delta Lake processing. Strong background in integrating REST APIs, automating workflows with Azure Logic Apps, and optimizing storage in Azure Blob Storage. Proven ability to implement schema validation, audit logging, and data governance while troubleshooting pipeline issues and improving performance. Effective team collaborator supporting analytics, reporting, and operational insights across multiple clients.

Overview

1
1
year of professional experience

Work History

Azure Data Engineer

Y&L Consulting, Inc.
04.2025 - Current
  • Develop and manage end-to-end ETL pipelines in Azure Data Factory to automate data ingestion, transformation, and loading into Azure SQL Databases.
  • Build scalable batch and streaming data transformations using Azure Databricks and PySpark.
  • Use Azure Logic Apps to automate scheduled tasks, notifications, and system integrations.
  • Perform database development, optimization, and troubleshooting in SSMS to maintain data accuracy and performance.
  • Design and implement storage solutions in Azure Blob Storage for raw and processed data.
  • Diagnose and resolve issues related to pipeline failures, delays, and performance bottlenecks.
  • Work with business and analytics teams to define data models and deliver validated datasets on time.
  • Implement data validation, error handling, and alerting to ensure high data quality and reliability.
  • Integrate external REST APIs into pipelines for real-time data enrichment when required.
  • Ensure compliance with data governance, security, and privacy standards across Azure solutions.
  • Collaborate with team members through regular meetings to ensure timely completion of tasks.

Technologies: Azure Data Factory, Azure Databricks, PySpark, Delta Lake, Azure SQL Database, Azure Blob Storage, SSMS, Azure Logic Apps, REST APIs, Git, Azure DevOps

Software Engineer

Keshav Consulting Solutions LLC
09.2024 - 03.2025
  • Developed backend components and REST APIs using Java and Python for secure, scalable cloud applications.
  • Assisted in building and maintaining ETL workflows to load data into Azure SQL Database and Blob Storage.
  • Integrated MySQL with application front ends to support smooth data access for users.
  • Contributed to designing cloud solutions using Microsoft Azure with a focus on data storage, retrieval, and performance.
  • Wrote and optimized SQL queries and stored procedures for application and reporting needs.
  • Worked with cross-functional teams to deliver scalable and maintainable application modules.
  • Followed best practices including version control, code reviews, and unit testing.
  • Supported deployment and troubleshooting of applications across development, staging, and production Azure environments.

Technologies: Java, Python, Azure SQL Database, Azure Blob Storage, Azure Data Factory, MySQL, REST APIs, SQL Server, Git, Azure DevOps

  • Developed and maintained software applications using Agile methodologies.

Education

Master of Science - Computer Science

Campbellsville University
Louisville, KY, USA

Bachelor of Technology - Computer Science and Engineering

Jawaharlal Nehru Technological University
Hyderabad, Telangana, India

Skills

  • Languages: Python, Java, SQL
  • Big Data & Processing: PySpark, Delta Lake
  • Cloud & Data Engineering: Azure Databricks, Azure Data Factory, Azure Blob Storage, Azure SQL Database, Azure Log Analytics
  • Databases: SQL Server, MySQL, PostgreSQL
  • ETL & Integration: ADF, SSIS, Databricks Auto Loader, REST APIs
  • Version Control & DevOps: Git, Azure DevOps
  • Tools: SSMS, Power BI

Timeline

Azure Data Engineer

Y&L Consulting, Inc.
04.2025 - Current

Software Engineer

Keshav Consulting Solutions LLC
09.2024 - 03.2025

Bachelor of Technology - Computer Science and Engineering

Jawaharlal Nehru Technological University

Master of Science - Computer Science

Campbellsville University