Dillon Carney
Westfield,NJ
Summary
Director-level QA leader with deep expertise in data quality engineering, automation frameworks, and AI/ML validation. Proven ability to build high-performing global teams, architect enterprise-scale quality strategies, and deliver measurable improvements in data accuracy, defect prevention, and engineering efficiency. Adept at transforming engineering workflows, modernizing QA operations, and partnering cross-functionally to elevate quality standards across complex product and data ecosystems. Accomplished with extensive experience in directing enterprise-wide quality assurance strategies and managing global teams across web, mobile, API, and microservices platforms. Well-versed in designing and implementing robust test automation frameworks, integrating CI/CD pipelines, and driving data quality, accessibility, and operational excellence initiatives. Adept at establishing processes for defect reduction, optimizing QA workflows, and fostering high-performing, collaborative, and inclusive team cultures. Skilled in leveraging Java, Selenium, Appium, TestNG, Maven, POM, SQL, and DevOps tools to deliver reliable, high-quality software in fast-paced Agile environments. Deep knowledge of Data Quality tools and AI landscape, leading to the creation of end-to-end data quality automation frameworks.
Overview
14
14
years of professional experience
Work History
Director, Quality Assurance
Audible, Inc. an Amazon Company
04.2025 - Current
- Lead global QA org supporting Data and AI engineering, marketing technology and machine learning.
- Direct and mentor global team of 10+ QA engineers and 3 contractors, overseeing quality initiatives across data, marketing technology, machine learning, and AI engineering domains. Orchestrate mid-year and year-end performance evaluations and compensation discussions to strengthen team engagement and drive measurable improvements in morale and effectiveness.
- Advanced organizational inclusion initiatives by chairing the Commerce Committee for AudABLE, the Disability Awareness impact group.
- Reduced defect rates reaching QA by implementing a mid-project defect analysis program to identify root causes and establish actionable improvements.
- Delivered month-over-month 100% GenAI adoption by enabling QAEs to lead Vibe Coding workshops and develop QA validation tools leveraging GenAI.
- Drove enterprise-wide GenAI integration, achieving 100% adoption by enabling QAEs to lead Vibe Coding workshops and develop QA validation tools leveraging GenAI.
- Reduced defect rates by implementing a scalable mid-project defect analysis program to identify root causes and establish actionable improvements.
- Elevated data reliability by maturing data quality standards, automated metrics validation, and cross-team instrumentation requirements.
- Influenced org-wide accessibility and inclusion as Chair of the Commerce Committee for AudABLE, the Disability Awareness impact group, partnering with Amazon-wide accessibility leaders.
- Cultivated a high-performing QA organization, earning top-tier Amazon Connections scores in Inclusion, Manager Skills, and Team Effectiveness.
Manager, Quality Assurance
Audible, Inc. an Amazon Company
12.2021 - 04.2025
- Owned strategy for data and metrics quality across product, analytics, and engineering teams. Scaled data validation processes, automation frameworks, and Operational Excellence programs aimed at onboarding 50+ QA engineers.
- Designed and implemented a strategic process for testing data and metrics for new features, enabling 50+ QA engineers to take long-term ownership of metrics validation.
- Served as technical advisor for Audible’s end-to-end metrics automation framework, leveraging AWS to support creation and execution of 340+ automated tests.
- Drove a 10% YoY increase in data quality satisfaction by launching the Shield Program, a cross-functional initiative focused on improving data reliability.
- Achieved 80% improvement in customer metric accuracy within six months by forming a specialized data quality team and rolling out structured oversight and training.
- Reduced aging defects by 60% and mitigated escalating security risks across nine teams through QA/IT Ops Operational Excellence initiatives and monitoring key performance metrics monthly.
- Drove a 10% year-over-year increase in data quality satisfaction by launching Audible’s Shield Program, a cross-functional initiative focused on enhancing data reliability.
- Achieved 80% improvement in customer metric accuracy within six months by directing formation of a specialized team to advance data quality initiatives at Audible through structured oversight and targeted training.
- Reduced aging defects by 60% and mitigated escalating security risks across nine teams by developing and overseeing QA/IT Ops Operational Excellence initiatives and monitoring key performance metrics monthly.
Senior Quality Assurance Engineer II
Audible, Inc. an Amazon Company
10.2019 - 12.2021
- Built an end-to-end automation framework, ensuring customer behavioral metrics like Adobe triggered with Selenium land in 8 different databases with the correct attributes using Java, Selenium, TestNG, and POM.
- 1 of 10 Correction of Error Bar Raisers at Audible, to identify growth opportunities for processes or systems following an issue or incident.
- Mentor for NJIT’s Society of Women Engineers, and Braven.
Quality Assurance Engineer II
Audible, Inc. an Amazon Company
05.2017 - 10.2019
- Spearheaded Audible accessibility initiatives by integrating 14 developer pipelines with Amazon Accessibility Evaluator, delivering global training, and forming Accessibility Committee for best practices.
- Designed and implemented the Audible QA on-call process across seven team aimed at ensuring accountability for automation failures, aging tickets, and adherence to mandatory updates.
Quality Assurance Engineer I
Audible, Inc. an Amazon Company
05.2016 - 05.2017
- Enabled reliable testing across ten marketplaces by developing a CI/CD web automation framework leveraging Java, Selenium, POM, and TestNG.
- Achieved zero production issues across ten marketplaces by leading testing for Audible’s desktop and mobile website platform migration over one year.
Quality Assurance Automation Engineer
Major League Baseball Advanced Media
11.2014 - 05.2016
- Executed and evaluated load testing for high-traffic streaming services, including MLB, HBO Now, NHL, PGA, and WWE, utilizing SOASTA CloudTest to ensure optimal performance under peak conditions.
- Managed mobile application builds and streamlined App Store submissions for multiple apps through Jenkins, GitHub, and Gradle to ensure timely deployment and release quality.
- Enhanced testing efficiency and reliability by developing and maintaining automated test scripts for web, mobile, and API platforms using Java, Selenium, Appium, TestNG, Maven, POM, and Postman.
Quality Assurance Automation Engineer
Billtrust
06.2012 - 11.2014
- Improved quality and reliability across complex FinTech web applications and five payment gateways by deploying a CI/CD test automation framework.
Education
Master of Business Administration - Finance
Rowan University
Bachelor of Science - Management Information Systems
Rowan University
Skills
- Automation: Java, Selenium, Appium, TestNG, Maven
- Platforms: AWS, Jenkins, GitHub, Gradle
- Domains: Data Quality, Metrics Validation, ML/AI, Accessibility
- Areas of Expertise: CI/CD Integration, Operational Excellence, RCA
HONORS & AWARDS
Audible Data Quality Award 2025, Amazon Accessibility Awareness Award, 2020, Audible Marketing Partner of the Quarter Award, 2019, Audible Customer Obsession Award, 2018
SPEAKING EXPERIENCE
- Delivered sessions on Accessibility, Continuous Delivery, Operational Excellence, QA On-Call, and Load Testing at PowerToFly, Amazon Test UnConference, Test Masters Academy (NYC), and DevOpsQANJ.
- Getting Started With Accessibility, PowerToFly, Virtual, 2021
- Getting Started With Accessibility, Amazon World Wide Test UnConference, Virtual, 2021
- Getting Started With Accessibility, Test Masters Academy – Skills Upgrade for QA, New York, NY, 2020
- Getting Started With Accessibility, Test Masters Academy – ConTEST, New York, NY, 2019
- Continuous Delivery, Amazon Test UnConference, Seattle, WA, 2019
- QA On-call, Amazon Test UnConference, Seattle, WA, 2019
- Operational Excellence for QA, Amazon Test UnConference, Seattle, WA, 2019
- Load Testing with SOASTA CloudTest, DevOpsQANJ, Jersey City, NJ, 2016
Timeline
Director, Quality Assurance
Audible, Inc. an Amazon Company
04.2025 - Current
Manager, Quality Assurance
Audible, Inc. an Amazon Company
12.2021 - 04.2025
Senior Quality Assurance Engineer II
Audible, Inc. an Amazon Company
10.2019 - 12.2021
Quality Assurance Engineer II
Audible, Inc. an Amazon Company
05.2017 - 10.2019
Quality Assurance Engineer I
Audible, Inc. an Amazon Company
05.2016 - 05.2017
Quality Assurance Automation Engineer
Major League Baseball Advanced Media
11.2014 - 05.2016
Quality Assurance Automation Engineer
Billtrust
06.2012 - 11.2014
Bachelor of Science - Management Information Systems
Rowan University
Master of Business Administration - Finance
Rowan University