Venkata Komal Sai Mantha
Plano,TX
Summary
Accomplished Data Engineer with a proven track record at Toyota North America, specializing in PySpark and Databricks. Enhanced data integrity and observability, achieving a 30% reduction in undetected pipeline failures. Adept at collaborating with cross-functional teams, driving impactful data solutions while maintaining high coding standards and best practices.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Data Engineer
Toyota North America
Plano, United States
02.2026 - Current
- Contributed to migrating 200+ enterprise applications from Amazon Redshift to Databricks Unity Catalog, supporting RBAC policy design and ensuring data integrity with zero data loss and zero unplanned downtime throughout the transition.
- Developed and maintained PySpark ETL pipelines processing vehicle, dealer, and supply chain datasets, improving average Spark job runtimes by ~25% through partition pruning, broadcast joins, and predicate pushdown optimizations.
- Architected data observability platform for 200+ enterprise applications, reducing undetected pipeline failures by ~30% and cutting mean time-to-detection for freshness issues from hours to minutes.
- Applied LLM-assisted tooling to generate data quality rules, produce metadata tags, and scaffold unit tests for PySpark jobs, reducing SQL and pipeline development cycle time by ~30%.
- Built automated cross-system data validation and reconciliation pipelines; identified and resolved recurring schema drift issues that had been causing silent failures in downstream reporting tables.
- Streamlined deployment workflows across dev, QA, and prod by introducing automated testing gates and approval checkpoints, reducing manual release intervention by ~35% in 200+ application pipeline.
- Collaborated with engineering and business teams to strengthen enterprise data trust by defining access policies and lineage tracking standards in Databricks Unity Catalog.
Data Engineer
Rapid App Werks
, Remote
08.2024 - 01.2026
- Designed and maintained scalable ELT/ETL pipelines on Databricks and AWS to ingest data from REST APIs, S3, and relational databases, supporting analytics teams across three concurrent product lines.
- Automated recurring data ingestion and transformation workflows using Python and Databricks Jobs, cutting approximately 35% of manual data preparation effort from the weekly analytics cycle.
- Automated manual processes and data pipelines using Python, cutting time spent on routine tasks.
- Built reusable data validation, reconciliation, and audit frameworks across 10+ source systems, reducing data quality incidents by ~20% and increasing analyst confidence in production datasets.
- Optimized SQL for datasets, reducing average job execution time by ~20% and lowering compute costs on AWS EMR and Databricks clusters.
- Developed Power BI dashboards and SQL reporting layers for business operations stakeholders, replacing manual Excel processes with scheduled, self-service reporting.
- Worked with data analysts, and domain experts to support research, analytics, and process improvements.
- Written clean, maintainable, and well-documented Python code following coding standards and industry best practices.
- Produced interactive dashboards, graphs, and pivots in accordance with business needs.
- Extracted, cleansed, and stored employee financial data.
- Utilized the Azure cloud platform's virtual data bank to import massive amounts of data for processing on Azure virtual machines.
- Used Git/GitHub for source code management, collaborated with team members on version-controlled projects.
Data Analyst
TechnePlus
, Remote
08.2023 - 03.2024
- Built and maintained Power BI dashboards tracking key business KPIs, enabling teams to monitor trends and identify anomalies without relying on manual reporting.
- Wrote SQL queries to extract and aggregate data from relational databases, facilitating weekly business performance reports for operations and management stakeholders.
- Performed exploratory data analysis (EDA) on structured datasets to identify patterns, outliers, and data quality issues, providing documented insights for senior analysts.
- Created pivot tables, charts, and summary reports in Excel to visually communicate analytical findings, enhancing understanding for non-technical stakeholders.
- Supported data validation and reconciliation tasks across source systems, flagging inconsistencies and coordinating with data owners to resolve discrepancies.
- Wrote Python scripts to automate repetitive data extraction and file formatting tasks, reducing manual preparation time for recurring weekly data loads.
- Collaborated with senior data engineers to understand pipeline dependencies and data lineage, developing foundational knowledge of end-to-end data flows.
- Assisted in running and monitoring scheduled data pipeline jobs, logging failures and escalating issues to the engineering team to maintain data availability for downstream reports.
- Supported senior engineers in building basic AWS Glue jobs to automate data movement from source files to structured tables, learning ETL concepts in a cloud environment.
Education
Master of Science - Electronics
Nottingham Trent University
United Kingdom12-2021
Bachelor of Technology - Electronics & Instrumentation
Kakatiya Institute of Technology And Science Warangal
Warangal, India07-2016
Skills
- Python programming
- SQL database management
- ETL and ELT processes
- PySpark
- Databricks and Delta Lake
- AWS services (S3, Glue, Redshift, Athena, EMR, CloudWatch, Lambda)
- Data modeling (star and snowflake)
- Power BI visualization
- Data observability techniques
- CI/CD practices
- Git version control
- Agile and Scrum methodologies
Certification
Databricks Certified Data Engineer Associate, Databricks
Personal Information
Visa Status: Eligible for Skilled Worker Visa
Timeline
Data Engineer
Toyota North America
02.2026 - Current
Data Engineer
Rapid App Werks
08.2024 - 01.2026
Data Analyst
TechnePlus
08.2023 - 03.2024
Master of Science - Electronics
Nottingham Trent University
Bachelor of Technology - Electronics & Instrumentation
Kakatiya Institute of Technology And Science Warangal