Summary
Overview
Work History
Education
Skills
Certification
Timeline
ARCHITECTURE HIGHLIGHTS
Generic

Vamshidhar Adla

Dallas,TX

Summary

Senior / Staff Data Engineer with 10+ years of experience designing, implementing, and operationalizing scalable batch and real-time data platforms. Expertise in Python, SQL, Apache Spark, Kafka, and Snowflake with strong focus on event-driven architectures and streaming data solutions. Proven experience building certified datasets, enterprise data warehouses, and lakehouse-style platforms supporting analytics, BI, and operational systems. Adept in CI/CD integration, DevSecOps practices, and performance optimization to deliver reliable, secure, and high-performing data solutions.

Overview

10
10
years of professional experience
1
1
Certification

Work History

Senior / Staff Data Engineer – Enterprise Data Platforms

IBM
01.2019 - Current
  • Designed and implemented scalable data streaming and batch processing solutions supporting enterprise-wide analytics initiatives.
  • Architected Snowflake-based enterprise data warehouse using dimensional modeling and star schema design to optimize analytical performance.
  • Developed high-performance ETL/ELT pipelines using Python, SQL, and Apache Spark for ingestion from diverse structured and semi-structured sources.
  • Built event-driven data ingestion frameworks leveraging Spark Structured Streaming and Kafka to enable near real-time analytics.
  • Created and maintained certified datasets using layered architecture (bronze/silver/gold) with automated validation, reconciliation, and data quality checks.
  • Implemented incremental data processing strategies to improve efficiency and reduce compute costs.
  • Led orchestration of complex data workflows ensuring SLA adherence and production reliability.
  • Monitored and optimized large-scale data pipelines to ensure high availability, scalability, and performance tuning.
  • Integrated CI/CD pipelines for automated deployment, testing, and version control of data engineering solutions.
  • Partnered with data scientists, analysts, and business stakeholders to translate functional requirements into scalable production systems.
  • Ensured compliance with enterprise data governance, security, and data protection standards.

Data Engineer

Acadia Technologies Inc.
10.2016 - 01.2019
  • Engineered enterprise-grade data warehouse pipelines supporting large-scale analytics and reporting platforms.
  • Developed complex SQL transformations, reconciliation frameworks, and validation logic ensuring high data integrity.
  • Designed and managed structured data models to support BI and operational reporting needs.
  • Collaborated with solution architects to streamline inbound and outbound data integrations.
  • Improved data quality processes within regulated environments ensuring compliance and audit readiness.
  • Contributed to performance optimization initiatives reducing data processing latency.

Systems / Data Engineer

Technumen Inc.
05.2016 - 09.2016
  • Designed and implemented fact and dimension tables using star schema modeling techniques.
  • Developed advanced stored procedures and transformation logic for optimized data processing.
  • Led migration efforts from Sybase to SQL Server using SSMA while maintaining data integrity.
  • Participated in Agile/Scrum delivery cycles for enterprise data platforms.

Education

M.S. - Computer Information Technology Services

Campbellsville University
USA

M.S. - Computer Science

University of Central Missouri
USA

B.Tech. - Electronics & Communication Engineering

JNTU Hyderabad
India

Skills

  • Apache Spark
  • Spark Structured Streaming
  • Kafka
  • AWS Kinesis
  • ETL/ELT
  • Data Orchestration
  • Data Integration
  • Snowflake
  • Dimensional Modeling
  • Data Quality
  • CI/CD Pipelines
  • Jenkins
  • GitHub, Version Control, Monitoring & Alerting
  • Cloud & Platforms : Microsoft Azure, Snowflake Cloud Data Platform

Certification

  • Microsoft Azure Data Engineer Associate (DP-203)
  • SnowPro Core Certification
  • Azure Fundamentals (AZ-900)
  • Azure Data Fundamentals (DP-900)
  • Certified ETL Tester (QuerySurge)
  • IBM Watsonx Essentials

Timeline

Senior / Staff Data Engineer – Enterprise Data Platforms

IBM
01.2019 - Current

Data Engineer

Acadia Technologies Inc.
10.2016 - 01.2019

Systems / Data Engineer

Technumen Inc.
05.2016 - 09.2016

M.S. - Computer Science

University of Central Missouri

B.Tech. - Electronics & Communication Engineering

JNTU Hyderabad

M.S. - Computer Information Technology Services

Campbellsville University

ARCHITECTURE HIGHLIGHTS

  • Hybrid Batch + Streaming Architecture for operational and analytical workloads
  • Event-Driven Data Ingestion using Kafka & Spark Structured Streaming
  • Enterprise Snowflake Data Warehouse with Dimensional & Star Schema Models
  • Lakehouse-style Data Architecture with Certified Data Layers
  • Data Orchestration with Monitoring & SLA Governance
  • CI/CD-Enabled Data Platform with Automated Testing & Deployment
  • Performance Optimization & Scalable Compute/Storage Separation
Vamshidhar Adla