Alexis JaQuay
AI Training & Quality Evaluation Specialist
Cedar Vale
Summary
AI Training and Quality Evaluation Specialist with experience spanning early NLP and computer vision systems through modern API- and JSON-based workflows. Skilled in model evaluation, prompt engineering, data annotation and validation, functional testing, and performance improvement. Recognized as a top contributor and trusted to write instructions, rubrics, and guidelines that scale high-quality AI training across distributed teams.
Overview
8
8
years of professional experience
Work History
AI Quality Analyst / AI Training Specialist
DataAnnotation
Remote
05.2020 - Current
- Reviewed, evaluated, and edited large volumes of AI training submissions to ensure accuracy, policy compliance, and high-quality model outputs.
- Provided detailed feedback and corrective edits to improve contributor performance and dataset reliability.
- Contributed to the development and refinement of project instructions, task guidelines, and evaluation criteria used by distributed AI training teams.
- Served as a subject-matter resource by answering project questions and clarifying requirements for contributors, reducing error rates, and rework.
- Participated in alpha testing of AI browser extensions and tooling, identifying bugs, usability issues, and edge cases prior to wider release.
- Selected for small, specialized teams based on consistent performance and quality metrics.
- Recognized as a top performer every year of engagement, reflecting sustained excellence, reliability, and impact.
- Offered advancement opportunities to administrative roles on multiple occasions, demonstrating leadership potential, and operational trust.
Search Engine Optimization / Early NLP Trainer
Appen
Remote
06.2018 - 05.2020
- Evaluated search engine results for relevance, accuracy, usefulness, and intent alignment in accordance with detailed quality guidelines.
- Provided clear, actionable, and constructive feedback to improve search result rankings and overall search experience.
- Assisted in assessing and improving website visibility across multiple search engines through SEO-focused analysis and evaluation tasks.
- Contributed to early-stage AI development by labeling, reviewing, and validating training data for foundational NLP and computer vision tasks, including logo recognition.
Skills
- AI Training & Evaluation
- API Tool Calling
- JSON & Structured Outputs
- Prompt Engineering
- Data Annotation & Validation
- Instruction & Rubric Writing
- Functional & API Testing
- Research & Quality Analysis
Timeline
AI Quality Analyst / AI Training Specialist
DataAnnotation
05.2020 - Current
Search Engine Optimization / Early NLP Trainer
Appen
06.2018 - 05.2020