Databases: Oracle 19c/18c/12c/11g/10g/9i/8i, DB2 V81, Snowflake, SQL Server2018/2008/2005, MySQL4/5, mongo DB, noSQL
Punnam Macharla
Atlanta,GA
Summary
Dynamic Lead Data Engineer with 15+ years of experience designing, building, and scaling cloud-native data platforms and distributed data pipelines. Strong background in Python, SQL, Spark, Azure, AWS, Snowflake and Databricks delivering high-quality, production-grade solutions for analytics and data-driven products. Proven technical leader with experience mentoring engineers, driving engineering best practices, and collaborating across product, analytics, and platform teams in Agile environments. Expert in ETL and Database development and performance tuning, fostering collaboration and mentoring teams. Adept at implementing CI/CD pipelines, enhancing data security, and driving impactful data migration projects.
Overview
16
16
years of professional experience
Work History
Lead Data Engineer
Optum
06.2020 - Current
- Lead the architecture and development of scalable, cloud-native data platforms supporting analytics, reporting, and machine learning use cases.
- Design and implement high-volume ETL/ELT pipelines using Python, PySpark, Spark, and SQL, processing structured and semi-structured data.
- Build and optimize batch and real-time data pipelines using Kafka and Spark Streaming for near-real-time insights.
- Architect and manage Azure based data solutions enterprise security and governance standards.
- Modeled predictions with feature selection algorithms.
- Provided professional services and support in a dynamic work environment.
- Develop reusable data ingestion frameworks to standardize pipeline development and improve engineering velocity.
- Partner with product managers, data scientists, analysts, and software engineers to translate business requirements into scalable technical designs.
- Implement CI/CD pipelines, automated testing, monitoring, and alerting to ensure production reliability and fast iteration.
- Perform deep performance tuning for Spark jobs, SQL queries, and warehouse workloads to reduce cost and improve efficiency.
- Conduct code reviews, enforce engineering best practices, and ensure maintainable, well-documented code.
- Mentor junior and senior engineers, providing guidance on system design, Spark optimization, and cloud architecture.
- Participate in Agile ceremonies, sprint planning, estimation, and delivery execution.
- Lead incident response, root cause analysis, and production readiness reviews.
Senior Data Engineer
Ally Financial Inc.
02.2017 - 06.2020
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Demonstrated strong organizational and time management skills while managing multiple projects.
- Participated in team projects, demonstrating an ability to work collaboratively and effectively.
- Gained strong leadership skills by managing projects from start to finish.esigned and built enterprise-scale data pipelines for analytics and reporting platforms.
- Migrated on-prem data systems to AWS and Snowflake, improving scalability and reducing infrastructure costs.
- Built PySpark pipelines on AWS EMR to process large datasets with high reliability.
- Developed data models and optimized warehouse schemas to improve query performance.
- Collaborated closely with DevOps and platform teams to enhance data platform reliability.
- Supported production systems through monitoring, alerting, and on-call rotations.
Sr Database Engineer
Alere Health
11.2011 - 01.2017
- Managed identification, protection and use of data assets.
- Designed data models for complex analysis needs.
- Developed and delivered business information solutions.
- Documented and communicated database schemas using accepted notations.
- Established and secured enterprise-wide data analytics structures.
- Developed database architectural strategies at modeling, design, and implementation stages to address business or industry requirements.
- Reviewed project requests describing database user needs to estimate time and cost required to accomplish projects.
- Planned and installed upgrades of database management system software to enhance database performance.
- Gathered, defined and refined requirements, led project design and oversaw implementation.
- Collaborated with system architects, design analysts and others to understand business and industry requirements.
- Demonstrated respect, friendliness and willingness to help wherever needed.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Participated in team projects, demonstrating an ability to work collaboratively and effectively.
Database Developer
Mercedes-Benz Financial Services
08.2009 - 10.2011
- Conducted tests to identify issues and make necessary modifications.
- Implemented security measures to protect vital business data.
- Modified databases to meet needs and goals determined during planning process.
- Cultivated and maintained effective working relationships with other developers and members of other departments.
- Developed scripts and processes for data integration and maintenance.
- Delivered complex business requirements without any issues by leveraging strong troubleshooting skills and extensive oversight.
- Created and updated database designs and data models.
- Set up and controlled user access levels across databases to protect important data.
- Built databases and table structures for web applications.
- Identified issues within databases, performed troubleshooting and implemented effective solutions.
- Wrote and maintained technical and functional specifications to document database intentions and requirements.
- Evaluated, designed, implemented, and modified databases and database applications.
- Created technical documentation for database technologies, providing updates.
- Managed identification, protection and use of data assets.
- Documented and communicated database schemas using accepted notations.
- Established and secured enterprise-wide data analytics structures.
- Developed database architectural strategies at modeling, design, and implementation stages to address business or industry requirements.
Education
Master of Science - Computer Science
The City College of New York
New York12-2009
Skills
- Data security
- Data integration
- Continuous deployment
- API development
- Relational databases
- Data modeling
- Version control
- Business intelligence
- NoSQL databases
- Continuous integration
- Data warehousing
- ETL development
- Python programming
- Performance tuning
- Advanced analytics
- Data analysis
- SQL and databases
- RDBMS
- Data migration
- SQL transactional replications
- Database design
- Big data technologies
- Technology leadership work streams
- SQL programming
Software
Programming Languages: Python, SQL, Java, Scala, PLSQL, TSQL and Shell Scripting
Cloud: Microsoft Azure, AWS, Google Cloud
Big Data & Streaming: Databricks, SAS, pache Spark, PySpark, Kafka, Spark Streaming
Orchestration & DevOps: Airflow, CI/CD, Git, Docker and Azure ADF
Data Engineering: ETL/ELT, Data Modeling, Distributed Systems, Data Quality
Practices: Agile/Scrum, Code Reviews, Unit Testing, Monitoring & Observability
Timeline
Lead Data Engineer
Optum
06.2020 - Current
Senior Data Engineer
Ally Financial Inc.
02.2017 - 06.2020
Sr Database Engineer
Alere Health
11.2011 - 01.2017
Database Developer
Mercedes-Benz Financial Services
08.2009 - 10.2011
Master of Science - Computer Science
The City College of New York