Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Shyam K Reddy

Plano

Summary

Dynamic Lead Software Engineer with a proven track record at CAPITAL ONE, specializing in cloud transformation and cost optimization. Expert in PySpark and AWS, driving multi-million dollar savings while enhancing data processing efficiency. Adept at fostering collaboration across teams to implement innovative solutions that ensure high availability and performance.

Overview

13
13
years of professional experience
3
3
Certifications

Work History

Lead Software Engineer

CAPITAL ONE
Dallas
08.2016 - Current

Platform Engineering & Cost Optimization (2022 – Present)

  • Strategic Migration: Architecting the transition of a massive Elasticsearch-based SIEM footprint to Databricks, leveraging PySpark for scalable ETL and Delta Lake for optimized storage.
  • FinOps Impact: Driving a multi-million dollar cost-reduction initiative by replacing high-cost indexing with a Lakehouse architecture, improving data retention by 30% while reducing infrastructure spend.
  • Data Engineering: Designing distributed data processing jobs in PySpark to handle high-velocity security logs, implementing Z-Ordering and partitioning strategies to minimize query latency.

Microservices & Container Orchestration (2018 – 2022)

  • Modernization: Led the migration of monolith services to a containerized microservices architecture using AWS EKS (Kubernetes) and ECS, enhancing deployment velocity by 40%.
  • Resiliency Engineering: Implemented service mesh and advanced auto-scaling protocols to ensure 99.99% availability for critical banking APIs under peak seasonal loads.
  • Standardization: Developed shared Terraform modules and CI/CD templates adopted by multiple teams to ensure security compliance and infrastructure consistency.

Cloud Transformation & Automation (2016 – 2018)

  • Legacy-to-Cloud: Orchestrated the end-to-end migration of bank-critical applications to AWS, ensuring SOC2 and PCI compliance through automated security controls.
  • Automation Rigor: Engineered a "zero-touch" deployment pipeline using Jenkins and GitHub, significantly reducing Time-to-Market (TTM) for new feature releases.
  • Monitoring: Established a comprehensive observability stack using Datadog and New Relic, reducing Mean Time to Detection (MTTD) of production incidents by 50%.

Systems Engineer

WALT DISNEY
Burbank
06.2016 - 07.2016
  • Accelerated the stabilization of core media delivery infrastructure, focusing on high-availability system performance and proactive bottleneck identification.

Programmer Analyst

EXPEDENT CORP
Dallas
02.2016 - 06.2016
  • Maintained existing software applications by troubleshooting issues and applying fixes.

Storage Engineer

ELJAY ENGINEERING
Chennai
04.2013 - 09.2014
  • Managed SAN/NAS storage environments for enterprise clients, focusing on disaster recovery planning and high-performance data provisioning.

Education

Masters - Computer Science

UCM
MO
01-2016

Bachelors - Computer Science

JNTU
India
01-2011

Skills

  • Programming languages: PySpark, Python, SQL, Shell scripting
  • Cloud & containers: AWS, Docker, ECS, EKS
  • Distributed systems: Databricks, Elasticsearch(ELK), Kafka
  • DevOps tools: Terraform, CloudFormation, CDK, Jenkins, Ansible
  • Monitoring tools: Datadog, Splunk, New Relic, CloudWatch

Certification

AWS Certified Solutions Architect – Associate

Timeline

Lead Software Engineer

CAPITAL ONE
08.2016 - Current

Systems Engineer

WALT DISNEY
06.2016 - 07.2016

Programmer Analyst

EXPEDENT CORP
02.2016 - 06.2016

Storage Engineer

ELJAY ENGINEERING
04.2013 - 09.2014

Masters - Computer Science

UCM

Bachelors - Computer Science

JNTU
Shyam K Reddy