Katie Coyle
Summary
Strategic Operations Manager and Quality Assurance Lead focused on optimizing workflows through AI evaluation and project management. Achievements include streamlined communication between teams and development of structured processes that significantly enhanced operational efficiency and customer satisfaction.
Overview
13
13
years of professional experience
Work History
AI Evaluation Contractor
Data Annotation
(Remote)
03.2026 - Current
- Evaluated hundreds of AI model outputs for accuracy, logical consistency, and strict guideline compliance, providing detailed written justifications to improve overall model usability.
- Conducted detailed comparative analyses of model outputs to identify inconsistencies and logical errors.
- Maintained high-quality performance while working independently in fast-paced remote environments.
- Provided feedback and solutions to enhance project usability and evaluator efficiency.
- Demonstrated adaptability across continuously evolving project guidelines and evaluation standards.
Operations Manager & Technical Project Lead
Audiomack
(Remote)
10.2020 - Current
- Managed development workflows for a team of 16 developers across simultaneous projects using GitHub and ZenHub.
- Acted as liaison between developers and non-technical stakeholders to translate requirements and prioritize tasks.
- Created and implemented structured escalation processes that reduced issue reporting turnaround time from days to hours.
- Developed and implemented scalable systems to support organizational growth, while establishing documentation standards.
- Led daily operations and cross-functional team meetings to drive project execution and strict timeline adherence.
- Authored and maintained over 50 customer-facing help articles, with step-by-step instructions for FAQs and newly released features.
Technology Quality Assurance and Compliance Lead
NotaryCam
(Remote)
12.2018 - 02.2021
- Led quality assurance testing, signing off on all fixes and features while creating changelogs in Jira and GitHub.
- Managed sprint planning and daily prioritization to meet project timelines.
- Troubleshot quality assurance challenges for the entire online notary platform, per tickets sent in via Freshdesk and Slack by customers, and internal tickets from team members.
- Recreated reported issues, investigated causes, identified critical workflow problems, and communicated all findings to the development team, where solutions were created and implemented.
- Analyzed feedback from customers, notaries, and stakeholders to refine systems and workflows.
- Managed a remote team of 28 notaries, enforcing strict quality assurance standards across audio and video platforms, including auditing and performance reviews.
- Spearheaded the end-to-end UX/UI redesign of the core NotaryCam platform, translating my hand drawn wireframes into high-fidelity prototypes using Figma to optimize user workflows and ensure strict compliance standards.
CSM/Certified Paraoptometric
ShannonVisionCare
, (TX)
09.2013 - 12.2018
- Managed electronic chart creation and updates for all patients at Shannon Vision Care.
- Conducted precise pre-testing and managed electronic charts for up to 20 patients daily.
- Delivered exceptional customer service by answering calls, scheduling appointments, and addressing inquiries.
- Trained new staff members while contributing to the development of innovative marketing strategies.
- Assisted staff in resolving complex customer issues and implementing effective solutions.
- Maintained quality control policies to enhance customer satisfaction.
- Resolved unusual billing discrepancies through thorough research and recommendations.
Education
Some College (No Degree) -
Collin College
Skills
AI & Technical Operations:
● AI Response Evaluation & Annotation ● Bug Reproduction & Documentation ● Web App Workflow Design ● Platform Testing ● Data Review & Validation ● UX/UI Design & Prototyping
Operations & Project Management:
● Operations Oversight ● Project Management ● Strategic Planning ● Workflow Optimization ● Budget Administration ● Process Mapping
Quality Assurance & Compliance:
● Quality Control ● Guideline Compliance ● Fact and Logic Evaluation ● Error Identification ● Root Cause Analysis
Leadership & Communication:
● Cross-Functional Communication ● Staff Management ● Conflict Resolution ● Analytical Writing ● Technical Documentation
Entrepreneurial Experience
Owner / Operator - Southern AZ Roadside LLC
12/2025 - Present
- Founded and launched a mobile roadside assistance business providing lockouts, jump starts, fuel delivery, and tire services.
- Built and customized AI-assisted no-code web application workflows for customer bookings, ride scheduling, dispatching, technician management, and operational tracking.
- Developed marketing strategy and local outreach to generate customer demand.
- Continual testing, debugging, and workflow optimization and features/enhancements.
- Responsible for operations budgeting, accounts payable, and accounts receivable and payroll.
- Set pricing structures according to market analytics and emerging trends.
Accomplishments
- 2020 HousingWire Insider Award — Recognized for outstanding contributions to the housing and mortgage industry (Awarded under former name, Katie Maxson).
Timeline
AI Evaluation Contractor
Data Annotation
03.2026 - Current
Operations Manager & Technical Project Lead
Audiomack
10.2020 - Current
Technology Quality Assurance and Compliance Lead
NotaryCam
12.2018 - 02.2021
CSM/Certified Paraoptometric
ShannonVisionCare
09.2013 - 12.2018
Some College (No Degree) -
Collin College