You have opted out of job matches in .
To undo this, go to the 'Skills and Interests' section of your preferences.
Posted about 2 months ago
Requirements and responsibilities
Evaluate outputs from large language models (LLMs) and autonomous agent systems against defined guidelines and rubrics. Review multi-step agent actions, including reasoning traces, to determine accuracy and quality. Provide detailed, structured feedback to inform benchmarking, product evolution, and model refinement. Participate in calibration sessions to ensure consistent evaluation criteria. Document findings and communicate insights clearly to relevant stakeholders.
Optionally, you can add more information later (benefits, pre-screening questions, etc.)