Analytical and detail-oriented freelance professional with a Master's in Data Science and extensive experience in AI model evaluation, quality assurance, and research. Expertise in testing language models, refining prompts, and ensuring rigorous benchmarking standards drives consistent results. Based in Austin, Texas, excels in fast-paced, remote environments while demonstrating a strong commitment to advancing frontier AI research. Eager to contribute to weekend-only Project Sprint by leveraging skills to enhance innovative projects and deliver impactful solutions.
Hi, I’m
Sophia Odoyo
Austin,Texas
Summary
Overview
5
years of professional experience
2
Certifications
Work History
Freelance AI Evaluator & Data AnalystNewark, Ohio
AI Evaluator & Data Analyst
01.2022 - Current
Job overview
- Conducted model testing for AI language models, evaluating outputs for accuracy, coherence, and alignment with project rubrics for tech clients.
- Supported quality assurance processes, refining prompts and ensuring consistency in model outputs for benchmarking purposes.
- Managed asynchronous workflows, delivering 15-30 hours of high-precision work weekly under tight deadlines.
- Utilized Python, SQL, and NLP tools to analyze data and provide actionable insights for AI development.
The University of Texas at AustinNewark, California
Research Assistant, AI & NLP Lab
08.2021 - 05.2023
Job overview
- Evaluated advanced language model performance, focusing on response quality, factual accuracy, and bias detection.
- Collaborated on developing evaluation rubrics for benchmarking, ensuring reliability and rigor for AI research projects.
- Co-authored a paper on prompt optimization, presented at a regional AI conference in 2022.
Freelance Content EvaluatorNewark, California
Content Evaluator
06.2020 - 12.2021
Job overview
- Reviewed and graded written outputs for automated content generation tools, providing detailed feedback to improve model performance.
- Conducted quality assurance for tech clients, ensuring content met project standards.
- Worked remotely, managing 10-20 hours weekly with a focus on precision and flexibility.
Education
The University of Texas at AustinAustin, TX
Master of Science from Data Science
05.2023
University Overview
- Focused on machine learning, natural language processing, and data evaluation.
- Thesis: "Optimizing Prompt Design for Bias Mitigation in Large Language Models."
Texas A&M UniversityCollege Station, TX
Bachelor of Arts from English Literature
05.2020
University Overview
Minor in Computer Science, emphasizing computational linguistics and text analysis.
Skills
Model Testing & Evaluation
undefinedCertification
Certified Data Analyst, DataCamp, 2022
Timeline
AI Evaluator & Data Analyst
Freelance AI Evaluator & Data Analyst
01.2022 - Current
Research Assistant, AI & NLP Lab
The University of Texas at Austin
08.2021 - 05.2023
Content Evaluator
Freelance Content Evaluator
06.2020 - 12.2021
Texas A&M University
Bachelor of Arts from English Literature
The University of Texas at Austin
Master of Science from Data Science