For companies:
For professionals:
For everyone:
Responsibilities
Role Overview:We are hiring for one of our clients, seeking a Agentic Coding Annotator - Online / Offline Tasks to work on a full-time basis. This role involves working with realistic coding tasks iewing model trajectories, verifying solutions, and producing high-quality annotations. Candidates are expected to read and debug code, validate behavior, follow detailed process rules, and make consistent judgment calls across model runs.Key Responsibilities:Execute realistic coding tasks within the assigned agentic coding harness while maintaining model blindness and session independenceFollow task instructions, milestones, planned interactions, and evaluation guardrails consistently across runsVerify model outputs by reading code, running commands, checking logs, and inspecting generated artifactsDesign multi-step, realistic coding tasks including user intent and milestone structure for offline evaluationsWrite clear, specific, evidence-based rationales for trajectory rankings and assessmentsRequired Skills & Qualifications:Proficiency aScript, Java, C++, or SQL for code analysis and debuggingExperience working with realistic software tasks beyond toy problems or shallow code-review exercisesAbility to design task-specific rubrics and binary evaluation criteria for model outputsStrong attention to detail to ensure high-quality annotations and consistent gradingComfort with debugging, test validation, and manual verification of software behaviorMore About the Opportunity:This role offers a unique opportunity to work with a global leader ormation and Internet industry, contributing to the advancement and deployment of powerful AI systems. The work directly supports the development of agentic coding models used for mission-critical applications.
Closes in:
0
days
0
hours
0
min
0
sec
tune NOT FOR YOU? IMPROVE YOUR RESULTS