Role: Software Engineer - Backend.
Opportunity Snapshot:
- Pay: $50–100 per task.
- Time per task: 5 hours for trainers and 1.5 hours for reviewers.
- Engagement: Project-based, paid per approved task.
- Commitment: Approximately 15 hours per week.
- Location: Fully remote.
Responsibilities:
- Create realistic, challenging coding tasks for frontier AI models, drawn from repositories you know well.
- Design problems that require real engineering skill, such as subtle bugs, non-trivial features, and meaningful performance work, rather than simple lookup or boilerplate tasks.
- Build a reproducible environment for each task.
- Write deterministic verifiers that accept correct solutions across different valid implementations, while rejecting incorrect, incomplete, or hard-coded approaches.
- Provide a reference solution showing how the task can be solved.
- Flag tasks that turn out to be ambiguous or unverifiable rather than submitting them.
- Create Reinforcement Learning Environments that test a model’s ability to solve real software engineering problems, including tracking down subtle bugs, building non-trivial features, refactoring, and optimizing performance.
Preferred Qualifications:
- Significant hands-on expertise in at least one of Python3, Java, Rust, Go, C++, or TypeScript.
- Deep understanding of algorithms, data structures, and software engineering principles.
- Proven ability to debug complex systems, resolve bugs, and deliver effective optimizations.
- Experience with large codebase refactoring and legacy system modernization.
- Track record of delivering high-impact features from conception through delivery.
- Strong documentation and communication skills to articulate technical concepts clearly.
- Interest in AI and its technical challenges, though previous AI experience is not required.
Compensation Structure:
- Compensation is output-based.
- Experts are paid per task that meets the project specifications.
- The time required may vary depending on experience and workflow.
