NATHAN McINTYRE
Boulder,CO
Summary
Data Architect with 20+ years architecting and implementing scalable data platforms from greenfield to production. Deep expertise in cloud-native data infrastructure (AWS, Snowflake), real-time streaming systems (Kafka, Kinesis), and event-driven architectures supporting billions of daily events. Proven track record designing CDC pipelines, implementing data governance frameworks, and establishing observability standards for mission-critical data systems. Passionate about building resilient, cost-effective data platforms that enable data-driven decision making at scale.
Overview
26
26
years of professional experience
Work History
Engineering Manager, Data
Buoy Software
Boulder, CO
04.2024 - Current
- Architected and implemented real-time CDC data platform using Kafka Connect, Debezium, and Snowflake, replacing batch ETL workflows with event-driven streaming pipelines processing 100+ tables with sub-minute latency
- Established data governance framework including SSO authentication, private key rotation for service accounts, and role-based access controls (RBAC) in Snowflake, reducing security vulnerabilities by 90%
- Built event-based data ingestion service with AWS Lambda, S3, and Snowflake external stages, enabling automated data export workflows with configurable partitioning and retry logic
- Implemented observability stack with DataHub for lineage tracking, custom monitoring dashboards, and automated alerting for pipeline failures and data quality anomalies
Engineering Manager
Sovrn
Boulder, CO
07.2023 - 04.2024
- Oversaw the migration of Sovrn's Ad Exchange from bare-metal to AWS, supporting up to 100 billion requests per day, leveraging RedPanda and Aerospike for real-time bid stream processing
- Collaborated on Data Platform team's Kafka adoption, contributing to schema design, partition strategies, and monitoring infrastructure for distributed streaming workloads
- Managed the Exchange Core team, adopting OpenRTB 2.6 and GDPR/CCPA compliance
Technical Lead
Brooksource
Broomfield, CO
01.2023 - 06.2023
- Led the development of a web application to support migrating telecommunication customer data for next generation product adoption using Python Flask and Oracle
- Automated application roll-out to separate environments to support end-user testing and API enhancements
Data Engineering Principal
Slalom Build
Denver, CO
02.2022 - 08.2022
- Migrated Scala jobs running on AWS EMR 5/Spark 2 to spot.io Ocean for Apache Spark
- Oversaw the integration of new technologies into existing systems for improved performance
- Managed and mentored five Data Engineers
Lead Data Engineer
RxRevu
Denver, CO
03.2021 - 05.2021
- Helped migrate infrastructure setup to Terraform for resiliency, automation, and disaster recovery
- Supported Data Analysts in debugging and optimizing Apache Airflow jobs
Data Engineering Principal
Slalom Build
Denver, CO
07.2019 - 03.2021
- Established ETL pipelines for consuming agronomic and geospatial data utilizing AWS Glue and Snowflake
- Architected processes for consuming near real-time CDC events from upstream Oracle RDS instances to AWS Kinesis for downstream consumers
- Led the development of COVID-19 analytical pipelines and dashboards based on over 40 disparate data sources
- Helped build Slalom Build's Data & Analytics practice in managing and mentoring a team of six Data Engineers
Lead Data Engineer
Gaia
Louisville, CO
03.2019 - 07.2019
- Migrated data warehouse batch ETL processes to an event-based system using Apache Airflow
- Supported the Data Science team in building and deploying recommendation systems
Data Engineering Manager
Ibotta
Denver, CO
05.2018 - 03.2019
- Defined the strategic vision for the department within Ibotta's Data & Infrastructure group
- Grew and managed a team of six high-performing individuals, including three senior engineers
- Stabilized the primary BI reporting pipeline leading to a rolling 30-day 99.9% uptime
- Spearheaded the adoption of event-based architecture for micro-services
Senior Data Engineer
Ibotta
Denver, CO
01.2018 - 04.2018
- Led the migration from a Redshift Data Warehouse usage over to an S3 data lake utilizing Apache Airflow, Spark, Hadoop/Hive, and Presto
- Tech lead for Data Engineering, representing the team in architectural decision
Big Data Engineer
Ibotta
Denver, CO
03.2017 - 12.2017
- Architected the company Data Lake solution to allow scaling the organization's data assets and Analytics group
- Built the foundations for Ibotta's future event-based architecture
- Pioneered the use of Airflow and evangelized its adoption and use across both Engineering and Analytics departments
- Migrated existing ETL workflows to Airflow, eventually scaling to over 100x jobs a day
Senior Software Engineer
Return Path
Broomfield, CO
01.2015 - 10.2016
- Designed an AWS-based message queuing system to scale the processing of a high-volume email stream horizontally
- Refactored receipt parsing system to allow for arbitrary parsing of emails
- Developed web crawlers to automate scraping missing data points from Amazon product pages
- Implemented classification and predictive models using Python and Hadoop
Data Analyst
Return Path
Broomfield, CO
07.2011 - 12.2014
- Built model testing engines to help maintain and evaluate updates to models
- Transitioned IP scoring similarity model from Engineering to Analytics using R with Hadoop Streaming
- Developed processes for detecting and mapping marketing programs using Market Basket Analysis
Software Engineer
Return Path
Broomfield, CO
04.2008 - 06.2011
- Architected and oversaw teams implementing Map/Reduce processes to allow real-time processing for collecting and aggregating IP-based metrics
- Led the transition of product websites to support internalization and localization
- Developed a sendmail mister to allow throttling and processing of high-volume mail streams
Senior Programmer
Exploreos, Inc
Lake Mary, FL
03.2004 - 12.2007
- Administered and modeled MySQL databases and developed in-house solutions for MySQL replication
- Designed and developed web-based GIS applications using address normalization and TIGER/Line data
- Built online order processing systems capable of handling multiple, high-volume merchant accounts
Web Developer
HD Publishing, Inc
DeLand, FL
08.1999 - 12.2002
- Implemented web-based systems for real-time sales reporting
- Developed web applications to perform background searches on disparate public record sources
Education
Bachelor of Science - Pure Mathematics
University of Central Florida
Orlando, FL01.2003
Skills
- Cloud architecture and design
- Big data technologies
- Real-time data processing
- SQL expertise
- Data modeling
- Infrastructure-as-Code
- Agile methodology
- Data visualization
- Data analysis
Timeline
Engineering Manager, Data
Buoy Software
04.2024 - Current
Engineering Manager
Sovrn
07.2023 - 04.2024
Technical Lead
Brooksource
01.2023 - 06.2023
Data Engineering Principal
Slalom Build
02.2022 - 08.2022
Lead Data Engineer
RxRevu
03.2021 - 05.2021
Data Engineering Principal
Slalom Build
07.2019 - 03.2021
Lead Data Engineer
Gaia
03.2019 - 07.2019
Data Engineering Manager
Ibotta
05.2018 - 03.2019
Senior Data Engineer
Ibotta
01.2018 - 04.2018
Big Data Engineer
Ibotta
03.2017 - 12.2017
Senior Software Engineer
Return Path
01.2015 - 10.2016
Data Analyst
Return Path
07.2011 - 12.2014
Software Engineer
Return Path
04.2008 - 06.2011
Senior Programmer
Exploreos, Inc
03.2004 - 12.2007
Web Developer
HD Publishing, Inc
08.1999 - 12.2002
Bachelor of Science - Pure Mathematics
University of Central Florida