Summary
Overview
Work History
Education
Skills
Websites
Timeline
Generic
Shankar Venugopal

Shankar Venugopal

Fremont,CA

Summary

  • Data Engineering manager with 16+ years of experience leading and collaborating with cross geographical teams to create resilient and scalable data solutions. Leading a team of 13 team members.
  • Extensive e-commerce domain knowledge.
  • My core values - Be the customer, Innovate boldly, Deliver with impact, Be for everyone and Act with integrity.

Overview

18
18
years of professional experience

Work History

Manager, Data Engineering (MTS 2)

EBay Inc
San Jose
03.2019 - Current
  • Manage a dynamic engineering team of data engineers & software engineers located across geo’s.
  • Demonstrated strong leadership with an employee engagement score 10 points higher than the company average.
  • Lead with empathy to motivate teams to challenge the status quo and deliver high-quality data that drives business success.
  • Architected scalable data processing designs to support various data consumption patterns, including batch, near-real-time, and real-time.
  • Handle a diverse range of data solutions serving data science, advertising, product, finance, experimentation, and live site analytics needs.
  • Self Serve Analytics (SSA) - Envisioned and created tools to enable non-technical teams to analyze data without writing any code.
  • To build on the SSA tool, collaborated with CoreAI scientists to build a chat-bot feature to enable all personas to Ask a question, Discover data & Retrieve results with no code. My specific role is to prepare training and validation data from heterogeneous sources using data augmentation in PyTorch.

Member of Technical Staff

EBay Inc
San Jose
03.2017 - 03.2019
  • Created diverse data pipelines with Spark, Scala, Python, and SQL to process and transform data efficiently.
  • Conceive and implement a Write-Audit-Publish data quality tool to detect and mitigate anomalies, resulting in decreased remediation efforts and increased customer confidence.
  • Designed and deployed containerized applications using Docer and Tess.IO (Kubernetes @ eBay).
  • Proficient in leveraging behavioral and business event data to construct effective customer journey funnels.

Sr. DW Consultant

Akraya
San Jose, CA
11.2014 - 03.2017
  • Designed and implemented scalable data solutions.
  • Developed and maintained ETL pipelines to ingest and process data from heterogeneous sources.
  • Collaborate with data scientists and data analytics partners to build intuitive Business Intelligence solutions.
  • Optimized data pipelines in Teradata RDBMS, Hadoop & Spark to reduce latency & improve performance.

Senior Associate

Cognizant Technologies Solutions
San Jose, CA
12.2006 - 11.2014
  • Designed and implemented scalable data solutions.
  • Developed and maintained ETL pipelines to ingest and process data from heterogeneous sources.
  • Collaborate with data scientists and data analytics partners to build intuitive Business Intelligence solutions.
  • Optimized data pipelines in Teradata RDBMS, Hadoop & Spark to reduce latency & improve performance.

Education

Bachelor’s Degree - Electrical & Electronics Engineering

Anna University
Chennai, India
06-2006

Skills

  • Leadership
  • Enterprise Data Architecture
  • Big data eco-system - HDFS, Spark, Hive
  • Programming Language - Scala & Python
  • Stream processing - Kafka & Flink
  • Cloud computing - Kubernetes & Docker
  • BI tools - Tableau

Websites

Timeline

Manager, Data Engineering (MTS 2)

EBay Inc
03.2019 - Current

Member of Technical Staff

EBay Inc
03.2017 - 03.2019

Sr. DW Consultant

Akraya
11.2014 - 03.2017

Senior Associate

Cognizant Technologies Solutions
12.2006 - 11.2014

Bachelor’s Degree - Electrical & Electronics Engineering

Anna University

Similar Profiles

CREATE PROFILE
Shankar Venugopal