Shankar Venugopal
Fremont,CA
Summary
- Data Engineering manager with 16+ years of experience leading and collaborating with cross geographical teams to create resilient and scalable data solutions. Leading a team of 13 team members.
- Extensive e-commerce domain knowledge.
- My core values - Be the customer, Innovate boldly, Deliver with impact, Be for everyone and Act with integrity.
Overview
18
18
years of professional experience
Work History
Manager, Data Engineering (MTS 2)
EBay Inc
San Jose
2019.03 - Current
- Manage a dynamic engineering team of data engineers & software engineers located across geo’s.
- Demonstrated strong leadership with an employee engagement score 10 points higher than the company average.
- Lead with empathy to motivate teams to challenge the status quo and deliver high-quality data that drives business success.
- Architected scalable data processing designs to support various data consumption patterns, including batch, near-real-time, and real-time.
- Handle a diverse range of data solutions serving data science, advertising, product, finance, experimentation, and live site analytics needs.
- Self Serve Analytics (SSA) - Envisioned and created tools to enable non-technical teams to analyze data without writing any code.
- To build on the SSA tool, collaborated with CoreAI scientists to build a chat-bot feature to enable all personas to Ask a question, Discover data & Retrieve results with no code. My specific role is to prepare training and validation data from heterogeneous sources using data augmentation in PyTorch.
Member of Technical Staff
EBay Inc
San Jose
2017.03 - 2019.03
- Created diverse data pipelines with Spark, Scala, Python, and SQL to process and transform data efficiently.
- Conceive and implement a Write-Audit-Publish data quality tool to detect and mitigate anomalies, resulting in decreased remediation efforts and increased customer confidence.
- Designed and deployed containerized applications using Docer and Tess.IO (Kubernetes @ eBay).
- Proficient in leveraging behavioral and business event data to construct effective customer journey funnels.
Sr. DW Consultant
Akraya
San Jose , CA
2014.11 - 2017.03
- Designed and implemented scalable data solutions.
- Developed and maintained ETL pipelines to ingest and process data from heterogeneous sources.
- Collaborate with data scientists and data analytics partners to build intuitive Business Intelligence solutions.
- Optimized data pipelines in Teradata RDBMS, Hadoop & Spark to reduce latency & improve performance.
Senior Associate
Cognizant Technologies Solutions
San Jose , CA
2006.12 - 2014.11
- Designed and implemented scalable data solutions.
- Developed and maintained ETL pipelines to ingest and process data from heterogeneous sources.
- Collaborate with data scientists and data analytics partners to build intuitive Business Intelligence solutions.
- Optimized data pipelines in Teradata RDBMS, Hadoop & Spark to reduce latency & improve performance.
Education
Bachelor’s Degree - Electrical & Electronics Engineering
Anna University
Chennai, India2006-06
Skills
- Leadership
- Enterprise Data Architecture
- Big data eco-system - HDFS, Spark, Hive
- Programming Language - Scala & Python
- Stream processing - Kafka & Flink
- Cloud computing - Kubernetes & Docker
- BI tools - Tableau
Timeline
Manager, Data Engineering (MTS 2)
EBay Inc
2019.03 - Current
Member of Technical Staff
EBay Inc
2017.03 - 2019.03
Sr. DW Consultant
Akraya
2014.11 - 2017.03
Senior Associate
Cognizant Technologies Solutions
2006.12 - 2014.11
Bachelor’s Degree - Electrical & Electronics Engineering
Anna University
Similar Profiles
ANSHUL MAHAJANANSHUL MAHAJAN
IOS Software Engineer at EBay IncIOS Software Engineer at EBay Inc
Antonio RiveraAntonio Rivera
Self Employed at EBay IncSelf Employed at EBay Inc
Joel CookJoel Cook
Sr. Manager, End User Support & Client Engineering at EBay IncSr. Manager, End User Support & Client Engineering at EBay Inc