Data Engineer Intern
Grepp
Irvine
09.2024 - Current
- Optimized existing queries by creating indexes on tables, resulting in a 30% reduction in query execution time.
- Developed and implemented data models, database designs, and data access protocols, improving database management efficiency through maintenance scripts.
- Automated periodic tasks using Airflow, saving 5 hours of manual work per week.
- Developed Python scripts to extract data from web service APIs and efficiently load it into databases, ensuring seamless data integration.
- Developed a machine learning model using TensorFlow to predict the spectrum of light passing through 8 different media, achieving 99.997% accuracy (model not deployed).
- Optimized the tech stack based on data usage and forecasted future increases in data usage to proactively prepare the infrastructure.
