Summary
Overview
Work History
Education
Skills
Technical Skills
Timeline
Generic

Shambhu Sharan Singh

SF Bay Area

Summary

Architect with 17 years of experience in designing scalable, low-latency systems for Tier-1 retail platforms. Expertise in distributed data platforms and large-scale big data applications utilizing Apache Spark and production-level GenAI solutions. Demonstrated success in architecting resilient, event-driven systems and leading engineering teams exceeding 50 members. Proficient in system scalability, performance optimization, and delivering effective solutions.

Overview

18
18
years of professional experience

Work History

Architect, ItemPage, Discovery E2E and UGC

Walmart
Sunnyvale
01.2025 - Current
  • Lead and mentor a 50+ member engineering organization, including 10+ technical leads, fostering technical excellence and scalable team growth
  • Architected resilient solutions for high-traffic discovery surfaces (Item Page and related pages) using Akamai Pagebank, significantly improving availability and fault tolerance
  • Spearheaded latency optimization for Item Page across web and native platforms, driving INP and LCP improvements through above-the-fold (ATF) and below-the-fold (BTF) rearchitecture
  • Served as end-to-end architect for multiple cross-functional initiatives, delivering complex, org-wide solutions with high technical alignment and execution precision
  • Led cloud cost optimization efforts, including Spark job redesign and Cassandra storage tuning, resulting in $2K+ daily savings
  • Scaled user-generated content (UGC) capabilities—boosted reviews and ratings coverage to 70% for head catalog (50+ reviews) and onboarded 6 tenants to the UGC platform while maintaining sub-50ms latency SLAs

Principal Engineer, UGC Team Lead

Walmart
Sunnyvale
05.2022 - 01.2025
  • Led engineering for the Ratings & Reviews platform, supporting billions of records and over 100 data processing jobs daily across e-commerce surfaces
  • Architected high-performance data pipelines using Apache Spark, Airflow, Kafka, and GCP (BigQuery, Hudi), enabling scalable, low-latency UGC ingestion and analytics
  • Designed real-time, event-driven review generation and enrichment workflows powered by Kafka, improving system throughput and reliability
  • Developed intelligent engagement pipelines to increase review generation through personalized customer outreach, boosting review coverage and user participation
  • Delivered GenAI-based solutions for automated review summarization using LLMs (OpenAI/LLaMA), enhancing UX with digestible, high-quality insights in product pages
  • Championed GenAI innovation through multiple POCs—built real-time APIs and productivity tools that automated key developer workflows and enriched customer experiences

Staff Software Engineer, UGC

Walmart
Sunnyvale
02.2018 - 04.2022
  • Designed and implemented key backend features for the customer-facing and admin applications within the UGC platform, focusing on scalability, performance, and usability
  • Worked on projects aimed at improving review collection, enhancing customer engagement, and enriching the content depth of reviews
  • Built and optimized RESTful APIs to integrate seamlessly with various internal systems and ensure smooth user experience
  • Contributed to cloud cost optimization initiatives, identifying and eliminating inefficiencies in resource usage, leading to a reduction in operational costs
  • Design and Implement Pipeline to Ingest Customer Reviews, Customers Question-Answers and Checkout Comments using Apache Spark Framework(java) into Cassandra Database
  • Capacity planning, Holiday Preparedness, Performance Tuning for high traffic during holiday seasons

Senior Software Engineer, Search

Walmart
12.2012 - 02.2018
  • Architected Preso, the core API layer powering search and browse by integrating Solr, IRO, and other backend services
  • Built Guru, an automation tool for merchant-driven keyword classification and optimization
  • Led integration of Grocery into Walmart’s unified search experience
  • Partnered with the Ads team to surface sponsored results in search
  • Designed and executed migration from Endeca to Walmart’s in-house Polaris search engine
  • Developed internal tools (e.g., Workbench) for merchandising use cases like redirects and rule-based logic

Software Engineer

Infosys
10.2007 - 12.2012
  • Led SEO-driven demand generation initiatives at Walmart Labs, enhancing search relevancy using Lucene/Solr, Mahout clustering, and Hive-based analytics
  • Improved search functionality, Endeca configuration, and build automation to optimize performance and SEO for Walmart.com
  • Developed enterprise search features for SunTrust’s portal using Endeca, including document indexing and role-based search access
  • Delivered high-performance search and browse capabilities for Tesco’s e-commerce platform using Endeca and ATG, handling millions of SKUs
  • Built document management and enterprise search solutions for Infosys using SharePoint (MOSS 2007) and Endeca, improving knowledge access across the organization

Education

Bachelor of Technology - Computer Science

Dr MGR University
Chennai

Skills

Big Data & Data Engineering:
Apache Spark, BigQuery, Apache Airflow, Apache Kafka, GCP

Cloud Platforms:
GCP, Azure, WCNP, OneOps

Architecture & Systems Design:
Microservices, Event-driven architecture, RESTful APIs, graphQL, SOA

Data Storage & Retrieval:
Cassandra, Cosmos DB, Elasticsearch, Meghacache

Programming Languages:
Java, Python

LLM

openAI, openAI-realtime Llama, gemini

Technical Skills

Extensive experience leading cross-functional engineering teams, driving technical vision, mentoring senior engineers, and scaling organizational capabilities through effective hiring and team development., Deep expertise in building and optimizing large-scale data platforms using technologies such as Apache Spark, BigQuery, GCP (Google Cloud Platform), Apache Airflow, and Apache Kafka., Architected resilient, scalable systems leveraging microservices, event-driven architecture, RESTful APIs, and service-oriented architecture (SOA)., Designed and deployed solutions across major cloud platforms including Azure, GCP, WCNP, and OneOps, with a focus on high availability, cost optimization, and performance., Proficient in modern data storage and retrieval systems including Cassandra 4.x, Cosmos DB, Elasticsearch, and Meghacache, supporting high-throughput applications., Advanced proficiency in Java and Python; extensive experience with enterprise frameworks such as Spring Boot, Spring Cloud, Spring Web, and Spark.

Timeline

Architect, ItemPage, Discovery E2E and UGC

Walmart
01.2025 - Current

Principal Engineer, UGC Team Lead

Walmart
05.2022 - 01.2025

Staff Software Engineer, UGC

Walmart
02.2018 - 04.2022

Senior Software Engineer, Search

Walmart
12.2012 - 02.2018

Software Engineer

Infosys
10.2007 - 12.2012

Bachelor of Technology - Computer Science

Dr MGR University

Similar Profiles

CREATE PROFILE
Shambhu Sharan Singh