We are seeking a detail-oriented AI Data Quality Reviewer to help ensure the quality, accuracy, and integrity of data used in AI training and evaluation projects. In this role, you will review contributor submissions across text and video formats, assess them against project-specific guidelines, and make consistent quality decisions at scale.The ideal candidate has experience working in high-volume review environments, possesses exceptional attention to detail, and can apply detailed guidelines consistently while maintaining productivity targets. You will play a critical role in maintaining dataset quality, identifying suspicious or low-quality submissions, and providing clear feedback to contributors.Core Tasks:Review contributor submissions across text and video against project-specific guidelines and acceptance criteriaApprove, reject, or return submissions for correction while providing clear and feedbackMaintain high accuracy and consistency while meeting project throughput and turnaround-time targetsIdentify duplicate, low-effort, synthetic, manipulated, or otherwise suspicious submissions and escalate potential integrity issuesApply detailed review rubrics consistently across large volumes of submissionsTrack recurring contributor errors and flag unclear or ineffective task instructionsAccurately record review decisions, rejection reasons, and other required informationMust Have:1-3+ years of experience in data annotation, quality assurance, content moderation, trust & safety, document review, or another high-volume review environmentExperience reviewing the work or submissions of other people against defined guidelines, policies, rubrics, or SOPsExceptional attention to detail and ability to identify subtle errors, inconsistencies, and quality issuesStrong judgment and ability to make consistent decisions when reviewing large volumes of submissionsAbility to quickly learn and accurately apply new project-specific guidelines and acceptance criteriaStrong (C-level) written and verbal English communication skillsAbility to provide concise, clear, and constructive reviewer feedbackComfortable working toward measurable accuracy, productivity, and turnaround targetsStrong organizational skills and the ability to accurately document review decisionsAbility to work full-time EST hoursNice to Have:Previous experience reviewing AI training data, data annotations, RLHF tasks, or human-generated datasetsBackground in content moderation, trust & safety, fraud detection, data integrity, or marketplace quality control

AI Data Quality Reviewer

Emma

Responsibilities

Skills wanted:

Language(s) required:

Kyle Boyd

Kyle Boyd

About Talent Hackers:

trytalenthackers.com/

Admin access needed