Venugopal Kathirvel

• Led a team of 6 data engineers in designing and implementing a scalable and resilient data platform that processed 3.2 terabytes of data daily, resulting in a 55% reduction in processing time.

• Developed and maintained ETL pipelines using SAP Hana/Python to extract, transform, and load data from various sources, ensuring data accuracy and consistency.

• Collaborated with data scientists and analysts to design and optimize data models for business intelligence and reporting, leading to actionable insights and improved decision-making.

• Introduced performance optimization strategies, resulting in a 78% improvement in query response times and reduced resource utilization.

• Conducted regular code reviews, mentored team members, and organized training sessions to enhance technical skills and promote a culture of continuous learning.

* Maintained data pipelines up-time 99.9% while ingesting streaming and transactional data across 8 different primary data sources using Kafka, Spark, Apache Airflow, S3, Python & Snowflake

* Created ready to consume data sets for BI tools like Tableau & Mode using SQL, Salesforce API & Python to create Views & Materialized views for Live & Trending dashboards