Venkata Lanka
Austin,TX
Summary
Big Data Engineer with extensive experience in developing and deploying distributed data pipelines to analyze large datasets. He has exposure to most popular big data engineering frameworks including Spark, Hadoop, Airflow, Flink and other emerging open source technologies. He has worked towards solving complex big data needs in multiple sectors such as Autonomous Vehicles, Utilities, health care and e-Commerce industries
Overview
5
5
years of professional experience
Work History
Sr. Data Engineer
Wayfair LLC
01.2022 - 05.2023
- E-Commerce Industry with focus on everything home
- Worked in Data Insights team to create insights and metrics on usage of various cloud services
- Utilize Google Cloud services in creating scalable batch and streaming pipelines for processing large datasets
- Scraped across various teams storage utilization to create an optimal solution for the teams based on usage to reduce storage utilization by more than $5 million
- Leveraged various open source methodologies such as Docker, Kubernetes, Apache Spark and Apache Kafka along with Google Cloud Services
Data Engineer
Pacific Gas & Electric Corporation
07.2021 - 01.2022
- Electric utilities company which oversees electric power supply to the entire state of California
- Worked in Asset Failure Analysis & Grid Data Analytics Team as a Full-Stack Engineer with focus on data and backend applications
- Successfully created a pipeline for automating complex electrical principles in computing outages using data of various electrical sensors
- Eliminated manual computation of Defect Current and automated complex electrical methods for processing billions of line sensor logs
- Display the data to create a patrol zone for aiding field engineers to identify and resolve outages
- Extensively used Palantir Foundry in creating and scheduling data pipelines and also create UI Application for tracking various metrics
Simulation Engineer
American Haval Motor Technology LLC
04.2019 - 02.2021
- Autonomous Vehicle Startup company focusing to build Level 4 Autonomous Vehicles
- Successfully created simulation pipeline to ingest data from real-world and digital twins to simulate and test various Autonomous Vehicle level 4 features
- Created digital twins of a portion of Farmington Hills city for effectively testing drivability and effectiveness of AV features
- Created digital assets of various Autonomous Vehicle sensors such as Radar and Lidar
- Deployed and Automated simulation pipeline using AWS and Docker for automatic simulation runs triggered by code changes
Simulation Engineer
Aptiv - previously Delphi Corporation
01.2018 - 04.2019
- Autonomous Vehicle Company collaborating with leading OEMs in creating self-driving solutions
- Worked in Simulation & Data Processing Team for creating pipeline to store and process millions of miles of Autonomous Vehicle Data
- Worked on Open source platforms built on Unity Game Engine to create a simulation platform which can be used by multi teams
- Created and deployed multiple scenarios for validating Autonomous Vehicles
- Integrated with OEM contacts and other multi-disciplinary teams in creating cost-effective which cater to OEMs requirements
Education
Master of Science - Engineering
The Ohio State University
Columbus, OH12.2017
Skills
- SQL & Python
- Data Warehousing
- Scalability & System Design
- Google Cloud Services
- Amazon Web Services
- Batch and Real-Time processing
- Data Visualization - Looker and Tableau
- Docker, Kubernetes and CI/CD
- Terraform & Infrastructure as Code
Languages
Telugu
Native or Bilingual
Hindi
Full Professional
English
Full Professional
Timeline
Sr. Data Engineer
Wayfair LLC
01.2022 - 05.2023
Data Engineer
Pacific Gas & Electric Corporation
07.2021 - 01.2022
Simulation Engineer
American Haval Motor Technology LLC
04.2019 - 02.2021
Simulation Engineer
Aptiv - previously Delphi Corporation
01.2018 - 04.2019
Master of Science - Engineering
The Ohio State University
Similar Profiles
Sharavan GaragaSharavan Garaga
Campus & Early Career Recruiter at Wayfair LLCCampus & Early Career Recruiter at Wayfair LLC
Joshua CrockerJoshua Crocker
B2B Sales Manager at Wayfair LLCB2B Sales Manager at Wayfair LLC
Eveleen PablaEveleen Pabla
Human Resources Business Partner 1 at Wayfair LLCHuman Resources Business Partner 1 at Wayfair LLC
Olivia WaltersOlivia Walters
Learning and Development Associate at Wayfair LLCLearning and Development Associate at Wayfair LLC
BIANCA NAGATABIANCA NAGATA
Freelance Web Developer at FreelanceFreelance Web Developer at Freelance