Jake Stein
AI Data Annotator
Holbrook,NY
Summary
Experienced with data annotation techniques and tools to ensure high-quality data outputs. Utilizes attention to detail and analytical skills to enhance data accuracy. Knowledge of collaborative processes and adaptability in fast-changing environments. Proficiency in Python fundamentals and pandas data manipulation.
Overview
6
6
years of professional experience
3
3
years of post-secondary education
Work History
Data Annotator(Remote)
Alignerr
03.2025 - Current
- Performed audio-based stress testing using scripted speech with varied tone, speed, and accent.
- Reviewed transcripts in Labelbox, identifying and documenting errors in speech-to-text output.
- Evaluated multi-turn chatbot conversations for character trait consistency and grammatical errors.
- Provided detailed annotations and feedback to support the refinement of a conversational AI model.
Standardized Patient
Stony Brook Medicine - Clinical Simulation Center
10.2024 - Current
- Simulated clinical scenarios to assist 10-20 medical students in developing diagnostic skills.
- Provided real-time feedback to 10-20 medical trainees to enhance patient communication.
- Adapted to diverse case roles, ensuring accurate portrayal of symptoms and conditions.
- Contributed to medical education by facilitating hands-on, scenario-based training.
AI Trainer(Biology/Generalist)
Scale AI
07.2024 - Current
- Evaluated 30 or more AI responses for various metrics such as truthfulness, instruction following, and brevity.
- Investigated tool logs to identify and analyze errors in AI information extraction.
- Designed prompts to test AI model weaknesses and optimize output based on project requirements.
- Reviewed and refined assessments submitted by other AI trainers, ensuring accuracy, consistency, and adherence to project guidelines.
- Compiled, cleaned and manipulated data for proper handling.
Physical Therapy Aide
Long Island Sports and Rehabilitation Center
06.2019 - 12.2019
- Assisted in applying ankle weights to therapy patients, ensuring their safety and comfort.
- Helped 10 or more patients prepare for their therapy appointments through assisted stretching.
- Cleaned ice tub and made ice, guaranteeing a clean and ample supply for icing patient injuries.
- Managed laundry for towels, maintaining a steady supply for patient needs.
- Prepared heating pads by removing hot cloths from water and encasing them in a specialized wrap.
- Demonstrated flexibility and adaptability by seamlessly transitioning between various assignments to accommodate fluctuating patient caseloads.
Education
Bachelor's Degree - Health Science: Health Informatics Specialization
Stony Brook University
Stony Brook, NY 08.2021 - 05.2024
Skills
Python
Data Annotation
Prompt Engineering
Technical Support
Timeline
Data Annotator(Remote)
Alignerr
03.2025 - Current
Standardized Patient
Stony Brook Medicine - Clinical Simulation Center
10.2024 - Current
AI Trainer(Biology/Generalist)
Scale AI
07.2024 - Current
Bachelor's Degree - Health Science: Health Informatics Specialization
Stony Brook University
08.2021 - 05.2024
Physical Therapy Aide
Long Island Sports and Rehabilitation Center
06.2019 - 12.2019
Similar Profiles
Caitlyn HerrinCaitlyn Herrin
AI Data Trainer at AlignerrAI Data Trainer at Alignerr
Artur ShevchenkoArtur Shevchenko
AI Tutor at AlignerrAI Tutor at Alignerr
Jose RodriguezJose Rodriguez
NA at Alignerr, Alignerr | LabelerNA at Alignerr, Alignerr | Labeler
Angela RogackiAngela Rogacki
Bar Manager at Danfords Hotel And MarinaBar Manager at Danfords Hotel And Marina
Renee ManninoRenee Mannino
Practice Manager at Little Angels CenterPractice Manager at Little Angels Center