Vaibhav Singh
Principal Application Engineer
Aurora,IL
Summary
Principal Engineer/Manager | 2X AWS Certified | ETL Architect (Ab Initio) | Data Analytics | Data Quality Enthusiast
- Enthusiastic about Data Quality strategies and implementation.
- Proficient in designing and implementing event-driven data quality infrastructure, leveraging both open-source and AWS services.
- Principal Engineer with a proven track record of collaborating with diverse clients across various domains and environments over the past 13 years.
- Holds certifications as an AWS Certified Solution Architect Associate and Developers Associate, with a comprehensive understanding of numerous AWS services and their applications.
- Demonstrates adeptness in developing data pipelines to support data analytics solutions, encompassing data collection (Kafka/Kinesis, SQS, DMS), storage (S3/EMRFS, DynamoDB, RDS, Redshift), processing (EMR, Hadoop, Glue), analysis (Athena), and visualization (QuickSight, Kibana, Tableau).
- Proficient in DevOps practices with expertise in deploying applications on Openshift platforms.
- Expert in architecting, designing, and coding comprehensive Ab Initio ETL applications, including E>IT template and appconf development, as well as maintaining data warehouses and metadata management systems.
- Implemented Ab Initio integration with DevOps and established CI/CD pipelines using Ab Initio and Jenkins. Proficient in Python and shell scripting.
Overview
14
14
years of professional experience
6
6
Certifications
Work History
Principal Software Engineer
Discover Financial Services
12.2020 - Current
- Directing the implementation of a data quality strategy at Discover Financial Services while overseeing a team of 8 resources.
- Managing and maintaining data quality platforms, driving significant enhancements, and fostering adoption across data teams by facilitating their onboarding to the platforms.
- Led the development of critical features from ideation to launch, ensuring alignment with business objectives and stakeholder requirements.
Technology Specialist
Cognizant (Client: Discover Financial Services)
10.2019 - 11.2020
- Implemented an event-based pipeline utilizing Kafka, Python, Ab Initio DQE, HashiCorp Vault, Elasticsearch, and Kibana to conduct data quality assessments on S3 datasets. Orchestrated code deployment in Openshift from GIT repositories using Jenkins pipelines, with code execution on Openshift clusters and EC2 instances. Employed Python modules for credential provisioning, Kafka consumers for data ingestion, and HashiCorp Vault for secure credential management. Established a robust CI/CD pipeline for DevOps practices and developed APIs using Python, complemented by insightful Kibana Dashboards for monitoring and analysis.
Technology Specialist
Cognizant (Client: Walgreens)
08.2018 - 10.2019
- Developed a versatile Ab Initio DML parser tailored for claim load files, with ongoing enhancements for regular BAU operations and blueprints for seed data implementation.
Lead Data Engineer
Cognizant (Client: Express Scripts)
02.2014 - 07.2018
- Developed a Regression Test Automation (RTM) tool leveraging Ab Initio graphs and E>IT. Crafted E>IT templates and appconfs from the ground up, while designing generic graphs using PDL for metadata retrieval and transformation generation.
- Implemented ABL Benefit Builder for loading benefits information into the database, facilitating Automated Benefit Load and group load processing. Additionally, designed WellPoint Reporting in a color-coded Excel format using Ab Initio.
Sr. Associate Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
10.2012 - 01.2014
- Building graphs and plans from the scratch, Looping plans and resource pooling
- Policy Delete Reload Tool – Premium Datawarehouse (Ab Initio)
- Intraday Processing – Premium Datawarehouse(Ab Initio)
- ETL Alerts - Global (Unix)
- Query Banding – Global (Ab Initio, Teradata)
- Loss Datawarehouse enhancements
Associate Data Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
07.2010 - 10.2012
- Trained in Informatica
- Building graphs and plans from the scratch, Looping plans and resource pooling
Education
Bachelor of Engineering Technology -
Laxmi Devi Institute of Engineering And Technology
05.2001 -
Skills
Data Quality Strategy and Implementation
Certification
AWS Solution Architect Associate
Personal Information
Visa Status: H1B approved till 11/2026 (I140 Approved)
Timeline
Principal Software Engineer
Discover Financial Services
12.2020 - Current
Technology Specialist
Cognizant (Client: Discover Financial Services)
10.2019 - 11.2020
Technology Specialist
Cognizant (Client: Walgreens)
08.2018 - 10.2019
Lead Data Engineer
Cognizant (Client: Express Scripts)
02.2014 - 07.2018
Sr. Associate Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
10.2012 - 01.2014
Associate Data Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
07.2010 - 10.2012
Bachelor of Engineering Technology -
Laxmi Devi Institute of Engineering And Technology
05.2001 -
Similar Profiles
Latasha PalmerLatasha Palmer
Home Loans Document Specialist at Discover Bank/Discover Financial ServicesHome Loans Document Specialist at Discover Bank/Discover Financial Services
Justin SicienskiJustin Sicienski
Principal Product Manager (Commercial Payments) at Discover Global Network - Discover Financial ServicesPrincipal Product Manager (Commercial Payments) at Discover Global Network - Discover Financial Services
River BonsRiver Bons
Lead Account Specialist at Discover Financial Services, DFSLead Account Specialist at Discover Financial Services, DFS
DAWNE GARRETTDAWNE GARRETT
Senior Customer Service Representative at Discover Financial Services, DFSSenior Customer Service Representative at Discover Financial Services, DFS
Bailey SkrockiBailey Skrocki
Lead Server/Bartender/Host/Trainer at The Melting PotLead Server/Bartender/Host/Trainer at The Melting Pot