Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Avinash Reddy Chinthalapudi

Data Engineer
Boise

Summary

Experienced Data Engineer with 4 years of experience in designing and implementing data pipelines using SQL, GCP, PySpark, Airflow, snowflake and Python. Skilled in data modeling, data integration, and data warehousing. Proficient in database design, ETL processes, and data processing technologies. Dedicated to building scalable and reliable data solutions.

Overview

3
3
years of professional experience
3
3
years of post-secondary education
1
1
Certification

Work History

Global Quality Data Engineer

Micron
Boise
08.2022 - Current
  • Built pyspark scripts to NAND global quality teams to analyze the millions of rows data which saves 40% of engineers time.
  • Migrated data analysis pipeline from bigquery to pyspark which process more than billion rows in annual savings of GCP cost by 20%($18,000 per month) and increase processing speed by 40x.
  • Used GCP cloud composer(Airflow) to build data pipelines which manages compute engines by saving 30%($12,000 per month) of monthly cost.
  • Designed and built internal lot tracking system for qualification data by ingesting data into snowflake data warehouse which gives detailed information of lot status and estimated completion of process.
  • Deployed pyspark scripts by containerizing using cloud build and deploy using CI/CD which reduced deployment process from 45 minutes to 10 minutes.
  • Migrated ETL process across high volume data from on-prem VM to GCP compute engines by using cloud composer(Airflow) which reduces VM hardware cost and increase the speed of ETL jobs by 8hrs which is 40x faster.

Test Data Engineer

Micron
Boise
02.2020 - 07.2022
  • Core developer of the team which builds data products to analyze and expedite the cycle of data learning Hardware Probe Data for R&D team and, supports Functional Test Program to validate hardware like DDR4 and DDR5.
  • Main resource to communicate with the customers on the weekly release, present the test benchmarks/analysis and facilitate audits by analysing complex data and identified anomalies, trends, and risks to provide useful insights to improve test methodologies.
  • Built a framework to perform co-relation and statistical data analysis of test and production hardware using JMP which helped us forecast the production yield by 10%.
  • Built a big data web application “DA-OLay” using NodeJS and JavaScript to generate a device overlay to identify the die fails based on different categories from the data and imprint it on the wafer, to support “DA-OLay”, built the backend in python script and refactored existing applications’ features to be 1.5x faster than original.
  • led the migration from local data source to GCP cloud storage using airflow and store in parquet format resulting in annual cost savings of $240,000 and increased performance by 14%.
  • Built ETL processes to extract data from various sources, such as relational databases, NoSQL databases, and flat files.
  • Designed and developed PySpark applications for data processing and analysis.

Education

Master of Science - Computer Science

California State University Sacramento
Sacramento
01.2017 - 12.2019

Skills

    SQL(MySQL, Bigquery)

undefined

Certification

AWS Certified Data Analytics - Specialty

Timeline

Global Quality Data Engineer

Micron
08.2022 - Current

AWS Certified Data Analytics - Specialty

09-2021

Test Data Engineer

Micron
02.2020 - 07.2022

Master of Science - Computer Science

California State University Sacramento
01.2017 - 12.2019

Similar Profiles

CREATE PROFILE
Avinash Reddy ChinthalapudiData Engineer