Al Data Annotator & Quality Evaluator verified_user
Verified experience
Handshake AI, Oneforma by Centific (Remote), Data Annotation llc
Jan 2023 - Current (3 years 6 months)
• Rate and evaluate Al-generated responses for quality, accuracy, tone, and alignment with human expectations across STEM, language arts, and general knowledge domains.
• Perform Needs Met and Page Quality assessments following UHRS and search quality rating guidelines, including evaluation of landing pages, relevance, and user intent.
• Complete transcript evaluation tasks assessing grammar, fluency, and content accuracy for English-language audio and written samples.
• Apply rubric-based scoring to creative writing, structured prompts, and short-form responses, providing detailed written rationales for all ratings.
• Contribute to LLM training datasets by generating diverse, high-quality prompt-response examples across multiple subject ar