Summary
Work History
Skills
Timeline
Overview
Education
Generic
Verified
This profile is verified using an email address.

Surabhi K S

Senior Data Operation/Quality/Reliablity/Production Operations Engineer
Redmond,WA

Summary

Senior Data Quality Engineer with 12+ years of experience delivering trusted, high-quality data across enterprise platforms in Telecom, Banking, Marketing, and Privacy Compliance domains. Specialized in ETL validation, production data operations, data reconciliation, SQL analytics, and Big Data validation. Supported large-scale Hadoop-based ecosystems, led validation efforts for 100+ StreamSets pipeline migrations, resolved production data issues through root cause analysis, and collaborated with Development and DevOps teams to ensure reliable data delivery. Contributed to CCPA compliance programs through validation of retention-based data deactivation processes and enterprise data governance controls.

Skilled in SQL, Python, Hive, Impala, PySpark, Hadoop, Oracle, StreamSets, Linux, and production support operations.

Passionate about Data Engineering and actively building end-to-end data pipeline and analytics projects

Work History

Senior Data Quality Engineer

Epsilon
Bengaluru , India
08.2021 - 12.2025

Worked on large-scale enterprise data platforms supporting Marketing, Identity Resolution, and Data Privacy initiatives across household, demographic, and transactional datasets.
Supported production data operations across 30+ upstream data pipelines processing high-volume data at enterprise scale.
Monitored, triaged, and resolved production pipeline failures by performing root cause analysis and coordinating with Development and DevOps teams.
Led validation efforts for migration of 100+ StreamSets pipelines across multiple enterprise applications, ensuring successful migration with minimal operational impact.
Supported StreamSets server migration activities including application onboarding, server configuration updates, wallet path management, database credential updates, and environment validation.
Worked closely with DevOps teams to troubleshoot infrastructure, access control, and sudo permission-related issues during migration and production support activities.
Built reusable SQL-based validation frameworks for post-load validation, data reconciliation, operational monitoring, and production data quality verification.
Performed source-to-target validation across Hive, Impala, Oracle, and distributed data platforms to ensure data accuracy and completeness.
Supported CCPA compliance initiatives by validating retention-based deactivation and removal of production data using SQL-driven verification processes.
Investigated and resolved PySpark job failures in production environments by analyzing execution logs, identifying failure patterns, and supporting pipeline recovery.
Supported production deployments, release validation, and operational readiness activities across multiple applications and data domains.
Collaborated with Data Engineering, Product, Business, and Infrastructure teams to ensure reliable delivery of critical enterprise data assets.
Contributed to operational documentation, migration runbooks, deployment procedures, and support knowledge repositories to improve platform reliability and team efficiency.

Technologies:
SQL | Python | Pandas | Hive | Impala | PySpark | Hadoop | Oracle | StreamSets | Git | Jira | Linux/Unix | Data Quality | ETL Validation | Production Support | Agile |Confluence Page| Jira

Senior Product Engineer

Harman Connected Service
Bengaluru , India
04.2019 - 07.2021

Worked on enterprise-scale ETL, database, Hadoop, and reporting validation projects.
Performed end-to-end testing of data pipelines, ensuring accuracy across source, transformation, and reporting layers.
Executed complex SQL queries for backend data validation and reconciliation.
Validated Oracle-to-Hadoop migration initiatives, ensuring source-to-target data consistency.
Performed Hadoop data verification and supported large-scale data processing workflows.
Conducted functional, integration, system, regression, smoke, and UAT testing.
Validated QlikView reports and dashboards used for business reporting and analytics.
Utilized UNIX/Linux commands for log analysis, data verification, and environment validation.
Participated in Agile/Scrum ceremonies including sprint planning, daily stand-ups, reviews, and retrospectives.
Collaborated with developers, business analysts, and stakeholders to validate business requirements and data quality.
Managed defect lifecycle using Jira and supported release validation activities.
Prepared release documentation, installation guides, and deployment verification reports.

Skills: SQL, Hadoop, Oracle, UNIX/Linux, ETL Testing, Data Validation, QlikView, Jira, Agile, Reporting Validation

Senior Associate Quality Control

Synechron Technologies (Client: Wells Fargo)
Bengaluru , India
08.2018 - 04.2019

Worked on enterprise risk management and regulatory reporting platforms for Wells Fargo.
Performed backend data validation and database testing using SQL.
Validated business-critical risk calculations, workflows, and reporting processes.
Executed functional, integration, regression, and user acceptance testing activities.
Collaborated with business analysts and development teams to ensure accurate implementation of requirements.
Identified, tracked, and managed defects throughout the software development lifecycle.
Supported Agile delivery processes and participated in sprint planning and review activities.
Contributed to quality assurance efforts for financial services applications and risk management systems.

Skills: SQL, Data Validation, Risk Platforms, Financial Services, Agile, Functional Testing, Reporting Validation

Senior Software Testing Engineer

Subex Ltd
Bengaluru , India
01.2014 - 08.2018

Worked on Telecom Revenue Assurance and Analytics platforms serving global telecom clients.
Performed ETL testing, database validation, and data quality verification across large datasets.
Executed SQL-based backend validation to ensure accuracy of revenue and billing data.
Participated in Oracle-to-Hadoop migration initiatives and validated source-to-target data movement.
Conducted revenue leakage analysis and validated telecom business rules and calculations.
Designed and executed functional, integration, system, regression, and user acceptance testing scenarios.
Developed and validated QlikView reports and analytics dashboards.
Collaborated with cross-functional teams to understand business requirements and ensure product quality.
Managed defect lifecycle using Subex Quality Center (SQC).
Prepared release notes, deployment documentation, and release validation reports.
Participated in Agile/Scrum-based software development and testing processes.

Skills: SQL, Hadoop, Oracle, QlikView, ETL Testing, Revenue Assurance, Telecom Analytics, Data Validation, Agile

Skills

SQL
Data Quality
ETL Testing
Data Validation
PySpark
Python
Hive
Impala
Hadoop
Databricks
Data Engineering
Data Pipelines
StreamSets
Data Reconciliation
Production Support
Root Cause Analysis
Oracle Database
Linux
Git
Jira

Timeline

Senior Data Quality Engineer

Epsilon
08.2021 - 12.2025

Senior Product Engineer

Harman Connected Service
04.2019 - 07.2021

Senior Associate Quality Control

Synechron Technologies (Client: Wells Fargo)
08.2018 - 04.2019

Senior Software Testing Engineer

Subex Ltd
01.2014 - 08.2018

Bachelor of Engineering - Computer Science

Visvesvaraya Technological University
08.2009 - 08.2013

Overview

12
12
years of professional experience
4
4
years of post-secondary education

Education

Bachelor of Engineering - Computer Science

Visvesvaraya Technological University
Karnataka , India
08.2009 - 08.2013
Surabhi K SSenior Data Operation/Quality/Reliablity/Production Operations Engineer