Summary
Overview
Work History
Education
Skills
Tools and Technologies
Timeline
Generic

Judson Gates

Data Engineer
Alexandria,VA

Summary

Diligent Data Engineer with robust background in data engineering and proven ability to design and implement complex data pipelines.

Overview

9
9
years of professional experience
14
14
years of post-secondary education

Work History

Senior Data Engineer

Tunnl
01.2022 - Current
  • Utilize technologies such as Databricks, PySpark, Spark SQL, Airflow, Delta Lake, Athena, S3, Clickhouse, and PostgresSQL to develop and maintain robust ETL pipelines used across the company.
  • Develop statewide/national voter and consumer data ingestion pipelines that run 3 times a week on average.
  • Wrote a 32 tier PII waterfall match utilizing techniques such as Soundex and Levenshtein distance to handle custom data matching and CCPA/privacy requests
  • Write highly customized data export pipelines for a constantly expanding list of onboarding partners, which currently sits at a count of 22.

Director of Product Innovation

Data Trust
04.2021 - 12.2021
  • Spearheaded exploratory outreach for current product expansion and new product creation
  • Managed defining project scopes and objectives, involving all relevant participants and ensuring technical achievability

Director of Data Operations

Data Trust
06.2020 - 04.2021
  • Wrote ETL pipelines to ingest voter registration data from over 250 state and county level sources at a 1-2 month refresh cadence. Cleaned and standardized data delivered in a variety of formats including CSV, JSON, SQL tables, and PDF.
  • Developed back-end API integrations for election night reporting dashboard

Data Acquisition Manager

Data Trust
05.2016 - 06.2020
  • Developed a proprietary ETL software in C# to automate data validation, cleansing, and ingestion.
  • Led a team in collecting, cleaning and processing more than 150 million records from 250 vendors on a recurring basis

Education

Bachelor of Arts - Telecommunications

Pennsylvania State University
State College, PA
05.2001 - 01.2015

Skills

  • Lakehouse Architecture
  • Spark development
  • ETL development
  • Data pipeline design
  • Big data technologies
  • Git version control
  • Data governance
  • Hiring and Training

Tools and Technologies

  • Programming Languages: Python, SQL, C#
  • Data Technologies: Databricks, Spark, Delta Lake
  • Databases: PostgreSQL, SQL Server, ClickHouse, AWS Athena
  • Cloud Platforms: AWS, Azure, GCP
  • ETL Tools: Apache Airflow, AWS Glue, SSIS
  • Version Control & CI/CD: Git, Docker


Timeline

Senior Data Engineer

Tunnl
01.2022 - Current

Director of Product Innovation

Data Trust
04.2021 - 12.2021

Director of Data Operations

Data Trust
06.2020 - 04.2021

Data Acquisition Manager

Data Trust
05.2016 - 06.2020

Bachelor of Arts - Telecommunications

Pennsylvania State University
05.2001 - 01.2015

Similar Profiles

CREATE PROFILE
Judson GatesData Engineer