MELISSA MATTHEWS

Afton,OK

Summary

Detail-oriented AI Data Annotator with a proven track record of enhancing Large Language Model (LLM) performance through reinforcement learning from human feedback (RLHF), fact-checking, and linguistic analysis. Expertise in high-stakes operational logistics and floor supervision complements strong technical skills in data labeling and model evaluation. Highly skilled in identifying edge cases, reducing model bias, and ensuring high-quality data outputs in fast-paced, deadline-driven environments. Committed to driving innovation and excellence in AI development through meticulous attention to detail and a results-oriented approach.

Overview

years of professional experience

Work History

AI Data Annotator

RWS

Remote

09.2025 - Current

Model Evaluation: Analyze and rank AI-generated responses to enhance the accuracy, safety, and helpfulness of Large Language Models (LLMs).
RLHF Implementation: Execute Reinforcement Learning from Human Feedback (RLHF) tasks, providing high-quality data labeling to refine machine learning algorithms.
Linguistic Analysis: Perform detailed audits of prompt-response pairs to ensure factual integrity and adherence to complex project guidelines.
Problem-Solving: Identify and document edge cases or model biases to support the development of more robust AI systems.

Amazon Delivery Driver

Amazon

Grove, OK

08.2021 - Current

Operational Excellence: Delivered packages with high efficiency, maintaining a 98% on-time delivery rate through strategic time management.
Navigation & Logistics: Utilized GPS and route-optimization tools to reduce average delivery times by 15 minutes per route.
Customer Relations: Handled customer inquiries and delivery specifications to ensure positive interactions and high satisfaction scores.
Safety & Compliance: Maintained strict vehicle safety standards and reported delivery issues promptly to minimize logistical delays.

D/R Floor Supervisor

Buffalo Run Casino

Miami, OK

07.2016 - 01.2017

Floor Management: Supervised gaming floor operations, ensuring full regulatory compliance and a seamless guest experience.
Conflict Resolution: Resolved guest disputes and technical issues quickly, maintaining a high standard of service and team morale.
Team Leadership: Improved team efficiency through active monitoring and coordination of floor staff during high-traffic shifts.

Skills

AI & Data Annotation

Machine Learning Support: RLHF (Reinforcement Learning from Human Feedback), SFT (Supervised Fine-Tuning)
Annotation Techniques: Data Labeling, Ranking & Scoring, Categorization, and Intent Analysis
Model Evaluation: Fact-checking, Hallucination Detection, Safety/Bias Auditing, and Persona Adherence
Linguistic Proficiency: Grammar, Syntax Analysis, Creative Writing, and Technical Summarization

Core Professional Skills

Technical Tools: GPS/Route Optimization, Gaming Regulatory Compliance, Digital Documentation
Logistics & Operations: Time Management, Efficiency Optimization, Fleet Safety
Leadership & Communication: Conflict Resolution, Guest Services, Team Supervision, and Training

Timeline