Kimberly Pierson
Johnson City,TN
Summary
I’m a passionate AI training specialist with extensive experience in RLHF through my work at Outlier AI, where I’ve contributed to some of the most advanced chatbot alignment and evaluation projects. My work spans prompt and system prompt engineering, safety testing, rubric creation, multimodal input evaluation, and detailed response writing and justification across dozens of categories and intent types. With a strong eye for nuance and consistency in model behavior, I take pride in crafting high-quality, human-aligned interactions. I’m currently earning my B.S. in Computer Science, which further fuels my commitment to building safe, intelligent, and user-centered AI systems.
Overview
5
5
years of professional experience
Work History
AI Chat Bot Trainer
Outlier AI
Remote
07.2023 - Current
- A member of the Oracle Team (since August 2024), reserved for top-tier RLHF contributors, based on consistent delivery of high-quality, high-judgment work across many complex projects.
- Designed and evaluated prompts and responses across a wide range of tasks, including (but not limited to) generation, summarization, classification, extraction, adversarial, and rewrite categories.
- Designed prompts in Science, Mathematics, History, Social Studies, Linguistics, Health and Medicine, Culinary Arts, Planning, and more categories.
- Authored precise rubrics for response evaluation, aligning model outputs with nuanced task expectations, and rated model responses based on rubric adherence.
- Probed model limitations, especially in hallucination, reference adherence, and system prompt obedience.
- Crafted prompts to test model adherence to system prompt guidelines on safety, appropriateness, bias, and non-harmful language, ensuring responsible AI behavior.
- Crafted ideal model responses for diverse creative and utility-based tasks, ensuring linguistic fluency, task specificity, and alignment with user intent.
- Rated and ranked model responses with detailed justifications, demonstrating strong judgment and interpretability skills.
- Created and evaluated prompts involving multimodal inputs to assess model perception and reasoning capabilities.
- Contributed to safety, consistency, and alignment efforts by identifying failure cases, model hallucinations, and response inconsistencies across adversarial and edge-case prompts.
Sales Manager - Call Center
Advanced Call Center Technologies LLC
Johnson City, TN
12.2021 - 03.2023
- Led a team of sales representatives in a high-volume call center, driving performance through coaching, quality monitoring, and strategic goal setting.
- Increased team sales conversion rates through targeted training and data-driven performance analysis.
- Managed daily operations including call scripts, performance metrics, customer engagement strategies, and issue resolution.
- Conducted regular training sessions on objection handling, compliance, and customer empathy, fostering a culture of accountability and growth.
- Recognized for top team performance and exceeding monthly revenue targets consistently.
- Developed strong communication, conflict resolution, and decision-making skills in a fast-paced, customer-facing environment.
Hostess
Applebee's
Greeneville, TN
02.2020 - 11.2021
- Greeted and seated guests in a fast-paced, high-traffic restaurant environment while managing waitlists and optimizing table turnover.
- Delivered exceptional customer service by anticipating guest needs, resolving concerns promptly, and creating a welcoming atmosphere.
- Maintained clear communication with servers and kitchen staff to ensure smooth front-of-house operations.
- Demonstrated strong multitasking, time management, and conflict-resolution skills during peak hours.
- Trained new host staff on customer service expectations, restaurant layout, and reservation systems.
Education
Bachelor of Science - Computer Science
University of Phoenix
Tempe, AZ04-2028
Skills
- Reinforcement Learning from Human Feedback
- Strong attention to detail
- Prompt Engineering
- System Prompt Stress Testing
- Sensitive Content/Safety Testing
- Response Evaluation & Ranking
- Rubric Design & Scoring
- Justification & Analytical Writing
- Model Behavior Analysis & Error Detection
Timeline
AI Chat Bot Trainer
Outlier AI
07.2023 - Current
Sales Manager - Call Center
Advanced Call Center Technologies LLC
12.2021 - 03.2023
Hostess
Applebee's
02.2020 - 11.2021
Bachelor of Science - Computer Science
University of Phoenix