Open To Work
NAGA YESWANTH BABU KOLLA
Raleigh,NC
Work Preference
Summary
Results-driven Technical Lead and Azure Data Engineer with over 5 years of experience in designing and delivering enterprise-scale cloud data platforms and modern ETL/ELT solutions. Expertise in building scalable data pipelines and cloud-native architectures using Azure technologies, alongside leading Agile teams and managing CI/CD processes. Skilled in cloud migration, data integration, and analytics, effectively translating business requirements into technical solutions to enhance data quality and operational efficiency.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Technical Lead
Tech Mahindra Americas Inc.
Durham, North Carolina, USA
02.2025 - Current
- Lead the design, development, and delivery of enterprise-scale Azure data engineering solutions supporting operational reporting, analytics, and business intelligence across multiple business domains.
- Architect and optimize cloud-native ETL/ELT pipelines using Azure Data Factory, Azure Databricks (PySpark), Azure SQL, Azure Synapse Analytics, ADLS Gen2, and Delta Lake.
- Led end-to-end Agile delivery as Technical Lead and Scrum Master, facilitating sprint planning, daily stand-ups, sprint reviews, retrospectives, and backlog refinement using Azure DevOps.
- Collaborate with Product Owners, business stakeholders, architects, and cross-functional teams to prioritize product backlogs, define sprint objectives, and deliver high-quality data solutions aligned with business priorities.
- Managed Agile work items, user stories, features, bugs, sprint boards, release planning, and sprint metrics using Azure DevOps, ensuring on-time delivery aligned with project timelines.
- Lead an offshore engineering team of 6+ developers by providing technical direction, conducting code reviews, mentoring engineers, and enforcing engineering best practices.
- Design scalable data integration frameworks for SAP, EDI, inventory, customer, product, territory, and sales data, enabling reliable downstream analytics and enterprise reporting.
- Improve pipeline performance by 30–40% through Spark optimization techniques including partitioning, caching, broadcast joins, Delta optimization, and efficient resource utilization.
- Develop enterprise data validation, reconciliation, and data quality frameworks to improve data accuracy, consistency, and reporting reliability across business-critical datasets.
- Collaborated with business users, QA teams, architects, and downstream reporting teams to analyze requirements and resolve complex data issues, enhancing platform capabilities.
- Support CI/CD deployment activities using Azure DevOps Pipelines, Git, and release management practices to streamline deployments across development, QA, and production environments.
- Technologies: Azure Data Factory (ADF), Azure Databricks, Azure SQL Database, Azure Synapse Analytics, Azure Data Lake Storage Gen2 (ADLS Gen2), Delta Lake, PySpark, Python, SQL, Spark SQL, Azure DevOps, Azure DevOps Pipelines, Git, CI/CD, Power BI, SAP, EDI, Azure Storage, ETL/ELT, Data Integration, Data Warehousing, Data Modeling, Data Validation, Data Reconciliation, Data Quality, Performance Optimization, Agile/Scrum, Sprint Planning, Production Support, Incident Management, Root Cause Analysis (RCA), Release Management, Stakeholder Management.
Data Engineer
TAIT Consulting LLC
Dallas, Texas, USA
10.2021 - 01.2025
- Designed, developed, and maintained enterprise-scale cloud data solutions using Azure Data Factory (ADF), Azure Databricks, Azure SQL Database, ADLS Gen2, and Snowflake to support financial reporting and analytics.
- Built ETL/ELT pipelines to ingest, transform, and load structured and semi-structured data from multiple enterprise systems into Azure and Snowflake data platforms.
- Developed high-performance data transformation workflows using PySpark, Python, SQL, and Spark SQL, processing over 10 million records with maintained data quality and reliability.
- Designed and implemented enterprise data warehouse solutions using Snowflake, leveraging dimensional modeling techniques including Star Schema and Snowflake Schema.
- Developed automated orchestration workflows using Azure Data Factory, implementing metadata-driven pipelines, parameterization, scheduling, dependency management, and monitoring.
- Optimized Spark and Snowflake workloads through query tuning, partitioning, clustering, caching, and resource utilization, improving pipeline performance.
- Built automated ingestion frameworks using Snowpipe, Azure Data Factory, COPY commands, external stages, and cloud storage integration for near real-time data processing.
- Developed reusable data validation, reconciliation, and auditing frameworks to ensure enterprise data accuracy, consistency, and regulatory compliance.
- Implemented Delta Lake best practices, incremental data loading strategies, watermarking, and change data capture (CDC) techniques for efficient data processing.
- Participated in cloud migration initiatives by modernizing legacy ETL processes and migrating enterprise workloads to Microsoft Azure and Snowflake.
- Technologies: Azure Data Factory (ADF), Azure Databricks, Azure SQL Database, Azure Data Lake Storage Gen2 (ADLS Gen2), Snowflake, PySpark, Python, Python, SQL, Spark SQL, Azure DevOps, Git, Delta Lake, Snowpipe, Azure Storage, CI/CD, Data Warehousing, ETL/ELT, Dimensional Modeling, Data Validation, Production Support.
Associate Professional
DXC Technology India Pvt. Ltd.
Hyderabad, India
06.2020 - 08.2021
- Developed enterprise data integration solutions for retail applications using SQL, Hadoop (HDFS, Hive, Spark), and REST APIs, enabling reliable data exchange across business systems.
- Developed complex SQL queries, stored procedures, and data validation scripts to support ETL processes, troubleshoot data issues, and improve reporting accuracy.
- Built and maintained ETL workflows for extracting, transforming, validating, and loading data from multiple source systems into enterprise reporting platforms.
- Worked with Hadoop ecosystem technologies (HDFS, Hive, and Spark) to process large datasets and support enterprise reporting and analytics.
- Executed data validation and reconciliation activities to ensure data accuracy between upstream and downstream systems.
- Collaborated with developers, QA teams, and business analysts to gather requirements, support application enhancements, and resolve production issues.
- Participated in System Integration Testing (SIT), User Acceptance Testing (UAT), regression testing, and deployment validation for enterprise applications.
- Investigated production incidents, performed root cause analysis (RCA), resolved application defects, and ensured adherence to production SLAs.
- Monitored batch jobs and data integration processes, proactively identifying failures and coordinating timely issue resolution.
- Participated in Agile ceremonies including sprint planning, daily stand-ups, backlog grooming, and sprint reviews while collaborating with cross-functional teams.
- Maintained technical documentation, operational procedures, support runbooks, and knowledge articles, enhancing team productivity and streamlining operational support.
- Technologies: REST APIs, SQL, Oracle SQL, Hadoop, HDFS, Hive, Spark, Python, JSON, XML, Runscope, Postman, ETL, Data Integration, Data Validation, Data Reconciliation, API Testing, Payload Validation, Schema Validation, System Integration Testing (SIT), User Acceptance Testing (UAT), Production Support, Incident Management, Root Cause Analysis (RCA), Agile/Scrum, Git.
Education
Master of Science - Business Analytics
University of New Haven
West Haven, Connecticut01-2023
Skills
- ETL pipelines
- Azure Data Factory (ADF), Databricks, Azure Synapse Analytics, Azure SQL, ADLS Gen2, Snowflake
- Python, PySpark, SQL, Spark SQL, Hadoop (HDFS, Hive), PowerShell
- Cloud Architecture
- Data Quality Management, Validation, Reconciliation, Dashboard Development
- Data governance
- Stakeholder management
Certification
- Microsoft Certified: Azure Fundamentals
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified: Data Engineer Associate
- Certified Scrum Master (CSM)
Languages
English
Full Professional
Timeline
Technical Lead
Tech Mahindra Americas Inc.
02.2025 - Current
Data Engineer
TAIT Consulting LLC
10.2021 - 01.2025
Associate Professional
DXC Technology India Pvt. Ltd.
06.2020 - 08.2021
Master of Science - Business Analytics
University of New Haven