Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Pragnya Nayak

Frisco,TX

Summary

Senior Data Engineer with 14+ years of experience spanning data engineering and software engineering, delivering large-scale, low-latency pipelines that power analytics, ML, and real-time applications. Expert in AWS, Airflow, dbt, Databricks, and Redshift, with a proven record of reducing cloud costs, cutting pipeline latency by 60%, and enabling millions of user transactions. Adept at leading architecture, mentoring teams, and delivering solutions in fast-paced startup and enterprise environments.

Overview

15
15
years of professional experience
1
1
Certification

Work History

Data Engineer

Current Health (Bestbuy Health)
Frisco, Texas
11.2021 - 06.2025
  • Architected and deployed mission-critical Airflow pipelines integrating Postgres, Kinesis, and Redshift, processing millions of health telemetry events/day with 99.99% uptime.
  • Built 60+ dbt models with automated data quality checks, reducing validation errors by 35% and accelerating analytics delivery from hours to minutes.
  • Designed AWS Glue workflows to ingest multi-TB datasets from S3 to Redshift, improving ingestion efficiency by 40%.
  • Implemented observability with Datadog, creating real-time dashboards & alerts for Redshift and data pipelines, cutting MTTR by 50%.
  • Managed infrastructure with Terraform, enabling repeatable, secure deployments across environments.
  • Mentored junior engineers, established data governance practices, and collaborated cross-functionally to deliver high-impact data solutions for product, marketing, and customer success teams.

Sr. Associate

Fannie Mae
Plano, TX
09.2020 - 04.2021
  • Migrated 100+ REST/SOAP APIs to Google Apigee, improving API security and performance by 25%.
  • Automated IAM user provisioning and permissions with Java APIs and AWS Lambda, reducing onboarding time from 3 days to under 2 hours.
  • Developed monitoring scripts in Python to proactively detect API failures, reducing downtime by 30%.
  • Containerized applications with Docker for consistent deployment across environments.

Principal Associate

Capital One
Dallas, TX
09.2018 - 09.2019
  • Led development of Dagger, an orchestration platform (Airflow, AWS, Python, Docker) adopted by 20+ teams, enabling migration of terabytes of data from on-prem to Snowflake and other destinations.
  • Built Flask-based onboarding APIs to register new DAGs and integrated SSO with it, cutting pipeline creation time by 50%.
  • Automated service restarts with AWS Lambda & CloudFormation, improving pipeline reliability.
  • Implemented infrastructure monitoring with Prometheus and Grafana, reducing incident resolution time.

Engineer

Elastic
Mountain view, California
05.2017 - 05.2018
  • Designed and deployed ELK stack solutions (on-prem & Elastic Cloud) for enterprise customers, enabling sub-second search on multi-TB datasets.
  • Led major version migrations of Elasticsearch with zero downtime.
  • Developed Beats/Logstash ingestion pipelines and Kibana dashboards for operational intelligence.

Sr. Consultant

Slalom Consulting
Dallas, TX
07.2015 - 03.2017
  • Architected streaming data ingestion from vehicles into Azure Data Lake using Java, Storm, and Kafka, enabling large-scale IoT analytics.
  • Migrated systems to modern frameworks using Scala, Play, Elasticsearch and Mongo, improving processing performance by 90%.
  • Led a team of three developers, building Spring Boot REST services, and integrated them with AngularJS UIs.

Sr. Software Engineer

Earlier Experience (Hitachi Consulting, McKesson)
Various Locations
11.2010 - 06.2015
  • Delivered enterprise application migrations from legacy stacks to Java microservices.
  • Implemented data-driven features, automated builds, and mentored junior engineers.

Education

Masters - Analytics

Georgia Institute of Technology
Atlanta, GA
12.2022

Master's - Computer Science

Utkal University
India

Skills


Data Engineering: Airflow, dbt, Databricks, Redshift, Postgres, ETL/ELT Pipelines, Mongo,SQL
Cloud & Infra: AWS (EC2, S3, VPC, Lambda, IAM, ECS, Glue, Kinesis, EMR, Aurora), Terraform, Docker
Streaming & Messaging: Kafka, Kinesis Streams, Storm
Monitoring & Observability: Datadog, Prometheus, Grafana, ELK Stack (Elasticsearch, Logstash, Kibana)
Programming: Python, Java, Scala, SQL, Shell Scripting
DevOps & CI/CD: Jenkins, GitLab CI/CD, Maven, Gradle
Other: Agile, TDD, API Design, Data Governance, Security Compliance

Certification

AWS Solutions Architect

Timeline

Data Engineer

Current Health (Bestbuy Health)
11.2021 - 06.2025

Sr. Associate

Fannie Mae
09.2020 - 04.2021

Principal Associate

Capital One
09.2018 - 09.2019

Engineer

Elastic
05.2017 - 05.2018

Sr. Consultant

Slalom Consulting
07.2015 - 03.2017

Sr. Software Engineer

Earlier Experience (Hitachi Consulting, McKesson)
11.2010 - 06.2015

Masters - Analytics

Georgia Institute of Technology

Master's - Computer Science

Utkal University

Similar Profiles

CREATE PROFILE
Pragnya Nayak