Priya Kotha
Dallas,TX
Summary
Accomplished Data Engineer with 9+ years of progressive experience architecting, building, and optimizing data solutions in cloud and big data environments. Expertise in PySpark, Databricks, AWS, Azure, Snowflake, and modern ETL/ELT frameworks. Adept at leading end-to-end data pipeline projects, driving best engineering practices, and collaborating with cross-functional teams to deliver scalable, high-performance analytics solutions. Proven ability to ensure data integrity, compliance, and security in highly regulated domains.
Overview
10
10
years of professional experience
1
1
Certification
Work History
Staff Data Engineer
Verana Health
02.2023 - Current
- Architected enterprise-scale ETL pipelines using Databricks and AWS. Led strategic data management and implemented POCs to modernize data ecosystems and promoted best practices across teams. Delivered Q data models that generated 10 million revenue. Saved 20% of the cost per annum by the optimization of data pipelines.
Senior Data Engineer
Capital One (Pyramid Consulting)
01.2021 - 02.2023
- Worked in Ad Sense Team and built AWS data lakes . Architected and developed ingestion frameworks with PySpark and automated data quality via Lambda & Airflow that helped customer churning by bringing in more than 25 million in revenue per annum
Senior Data Engineer
Novant Health, Inc (Tek Systems)
02.2019 - 01.2021
- Designed secure Azure Data Lake architectures and developed PySpark ETL pipelines and anonymized PII for compliance. Automated data integration & deployments with Azure DevOps.
Senior Data Engineer
Nike (Cloudwick Technologies)
08.2017 - 02.2019
- Built AWS pipelines for customer 360 data to create integrated data product that can used for membership churning and provide single point of source of truth to the dataset.
Data Engineer
Cadsci Technologies
12.2015 - 06.2016
- Supported Hadoop MapReduce apps, built ETL from RDBMS/UNIX to HDFS, developed Hive queries, and ensured software quality.
Education
Master's - Computer Science
University of Central Missouri
Warrensburg, MO12.2017
Bachelor's - Electronics and Communication Engineering
Sastra University
India05.2016
Skills
- Big Data & Analytics: PySpark, Hadoop, Hive, Sqoop, Databricks, Snowflake, Starburst, Airflow
- Programming: Python, SQL
- Cloud Platforms: AWS (EMR, EC2, S3, Lambda, Kinesis, Glue, Step Functions, Batch, RDS, DynamoDB, Athena, IAM, CloudWatch, SNS, SQS), Azure (Databricks, SQL, Delta Lake, ADLS Gen2, DevOps)
- DevOps & Infrastructure: GIT, Jenkins, Terraform, Kubernetes, Docker, SonarQube, Artifactory
- Others: Data Lake, ETL, Data Quality, Data Compliance & Security, CI/CD, Agile/Scrum
Certification
AWS Certified Solutions Architect - Associate
Timeline
Staff Data Engineer
Verana Health
02.2023 - Current
Senior Data Engineer
Capital One (Pyramid Consulting)
01.2021 - 02.2023
Senior Data Engineer
Novant Health, Inc (Tek Systems)
02.2019 - 01.2021
Senior Data Engineer
Nike (Cloudwick Technologies)
08.2017 - 02.2019
Data Engineer
Cadsci Technologies
12.2015 - 06.2016
Master's - Computer Science
University of Central Missouri
Bachelor's - Electronics and Communication Engineering
Sastra University
Similar Profiles
Nancy Ip-DialNancy Ip-Dial
Workplace Manager (Contract) at Verana HealthWorkplace Manager (Contract) at Verana Health
Megan FriesMegan Fries
Senior Practice Experience Manager at Verana HealthSenior Practice Experience Manager at Verana Health
SANTOSH REDDY KONNISANTOSH REDDY KONNI
Senior Data Engineer at Verana HealthSenior Data Engineer at Verana Health
Candace BrownCandace Brown
Training and Development Manager at The MexicanTraining and Development Manager at The Mexican
Daryl WilliamsDaryl Williams
Server at Evelyn Steakhouse Reach HospitalityServer at Evelyn Steakhouse Reach Hospitality