Summary
Overview
Work History
Skills
Certification
Timeline
Education, Honors And Awards
Education, Honors And Awards
Hi, I’m

Manpreet (Marty) Singh

Dallas,Texas
Manpreet (Marty) Singh

Summary

Data Engineer with 12+ years of professional experience in Java/J2EE, Python with expertise in Azure Data Lake, Big Data, Big Data Security and DevOps.

Extensive programming experience in Hadoop ecosystems of technologies including MapReduce, HDFS, Hive, YARN, Sqoop, Pig and PySpark.

Expertise in implementing server-side solutions managing scalability and concurrency, ingesting Big Data using batch processing and real time jobs, and deploying and administrating servers.

Experience in building Big Data pipelines using Apache Airflow. Experience with DevSecOps and working with CI/CD pipelines and source control branching strategies.

Proficient in building sophisticated distributed systems using REST and SOA.

Experience in working with and managing distributed teams in different time zones.

Deeply passionate about solving challenging technical problems.

Overview

14
years of professional experience
1
Certificate

Work History

UNITED HEALTHGROUP – UHC & OPTUM

Principal Data Engineer – Advanced Research & Analytics (ARA)
12.2017 - Current

Job overview

  • Migrated legacy systems to modern big-data technologies, improving performance and scalability while minimizing business disruption.
  • Developed and implemented data pipelines using Azure Data Factory resulting in a 50% reduction in processing time. Implemented data governance policies resulting in a 30% reduction in data quality issues.
  • Worked in specialized programs within Complex Health Solutions like Special Needs initiatives (SNI) and Dual Special Needs Plan (DSNP) that provided support to families with members having special needs.
  • Worked with variety of data sources including Member, Provider, Claims & Calls Data
  • Created reporting backend for COVID-19 Dashboard that provided key statistics around the pandemic.
  • Worked with Snowflake cloud data warehouse for integrating data from various source systems which include loading nested JSON formatted data into snowflake tables.
  • Worked on implementing a Fraud Waste and Abuse (FWA) detection strategic program using Java, Cassandra, Spark, Spark Streaming, Hive on MapR Hadoop distributed environment.
  • Created various Java/Spark applications for Social Network Analysis (SNA) to identify community of fraudulent providers and Derived Medical Records for deriving the likelihood of a disease based on other diseases on patient’s recent medical history.
  • Secured and restricted data for offshore access using Master Offshore Restriction List for various data sources.

BANK OF AMERICA

Big Data Consultant
08.2017 - 12.2017

Job overview

  • Optimized data storage and retrieval for faster processing, utilizing distributed database systems such as Hadoop and Spark.
  • Streamlined ETL processes for seamless integration of various data sources into a unified system.
  • Evaluated emerging big data technologies to stay current on industry trends and maintain competitive advantage.

AT&T, Inc.

Big Data Consultant
12.2016 - 08.2017

Job overview

  • Architected and implemented various Att.net and Att.com big data ingestion initiatives at AT&T mainly involving extraction, transformation, loading and analysis of big data using Sqoop, PySpark 2.x, Hive and Spark Streaming from various data sources into Big Data Lake cluster of size 400 nodes with 40 Petabytes capacity.
  • Implemented data pipelines in Apache Airflow
  • Implemented Hadoop platform as a service (PaaS) on Hortonworks Data Platform (HDP) automating HDP cluster installs with auto generated Ambari blueprints.
  • Implemented Metadata Encryption Service (AT&T) for encrypting data in Data Lake and used Apache Ranger for providing column level security for Hive queries
  • Performance tuning Spark applications.

UNITED HEALTHGROUP - OPTUM

Java/Big Data Lead Consultant
07.2014 - 12.2016

Job overview

  • Architected and developed Java Web Services (REST and SOAP) for Opportunity Gateway Manager (OGM) project which provides Lower Cost Alternatives (LCA) to brand medications to 10 million OptumRx members.
  • Created data pipelines from Oracle to Hadoop (Hive) Data Lake using Informatica.
  • Created a generic Java API Library for integrating IBM Interact with Web Services used in OGM and related projects.
  • Awarded Rock Star Performer award for implementing LCA project from start to finish in record time.

USAA

Java Consultant
04.2010 - 05.2013

Job overview

· Worked on various big data initiatives involving setting up Hadoop cluster, writing MapReduce jobs and setting up data pipelines.

Skills

  • Azure Data Engineering
  • Databricks
  • Spark Framework (Scala, Python)
  • Big Data Processing
  • Hadoop Ecosystem
  • Data Pipeline Design
  • Data Curating
  • Data Governance
  • Scripting Languages
  • Data Security
  • Data Migration
  • SQL Expertise
  • CI/CD

Certification

  • Azure Data Engineer Associate (DP-203)
  • Corporate Training in Snowflake
  • Informatica Big Data Developer and Informatica Data Quality Training
  • IBM Certified Xtify: IBM Mobile Customer Engagement Technical Master
  • IBM Certification in Silver Pop

Timeline

Principal Data Engineer – Advanced Research & Analytics (ARA)
UNITED HEALTHGROUP – UHC & OPTUM
12.2017 - Current
Big Data Consultant
BANK OF AMERICA
08.2017 - 12.2017
Big Data Consultant
AT&T, Inc.
12.2016 - 08.2017
Java/Big Data Lead Consultant
UNITED HEALTHGROUP - OPTUM
07.2014 - 12.2016
Java Consultant
USAA
04.2010 - 05.2013

Education, Honors And Awards

Education, Honors And Awards
  • Master’s Degree in Computer Science.
  • Bachelor’s Degree in Science.
  • IT Rock Star Award from UnitedHealth Group (Optum) for successfully implementing and leading Opportunity Gateway Manager program in 2015.
  • CVS Caremark Award for Innovation in Technology for creating iSribe PDA device for physicians.

Education, Honors And Awards

Education, Honors And Awards
  • Master’s Degree in Computer Science.
  • Bachelor’s Degree in Science.
  • IT Rock Star Award from UnitedHealth Group (Optum) for successfully implementing and leading Opportunity Gateway Manager program in 2015.
  • CVS Caremark Award for Innovation in Technology for creating iSribe PDA device for physicians.
Manpreet (Marty) Singh