Role Details:
- Role Title: Software Engineer - Backend.
- Role Type: Contractor (~15 hrs a week).
- Location: Remote.
Responsibilities:
- Create Reinforcement Learning Environments that test a model’s ability to solve real software engineering problems: tracking down subtle bugs, building non-trivial features, refactoring, and optimizing performance.
- Define the problem.
- Build a reproducible environment.
- Write a reference solution.
Scope of Work:
- Create realistic, challenging coding tasks for frontier AI models, drawn from repositories you know well.
- Design problems that require real engineering skill, such as subtle bugs, non-trivial features, and meaningful performance work, rather than lookup or boilerplate.
- Build a reproducible environment for each task.
- Write deterministic verifiers that accept correct solutions across different valid implementations, while rejecting incorrect, incomplete, or hard-coded approaches.
- Provide a reference solution showing how the task can be solved.
- Flag tasks that turn out to be ambiguous or unverifiable rather than submitting them.
Preferred Qualifications:
- Significant hands-on expertise in at least one of: Python3, Java, Rust, Go, C++, or TypeScript.
- Deep understanding of algorithms, data structures, and software engineering principles.
- Proven ability to debug complex systems, resolve bugs, and deliver effective optimizations.
- Experience with large codebase refactoring and legacy system modernization.
- Track record of delivering high-impact features from conception through delivery.
- Strong documentation and communication skills to articulate technical concepts clearly.
- Interest in AI and its technical challenges, though previous AI experience is not required.
Compensation Structure:
- Compensation is output-based.
- Experts are paid per task that meets the project specifications.
- The time required may vary depending on your experience and workflow.
Start Timeline & Availability:
- We typically fill roles within 48 hours and are looking for experts ready to jump in right away.
- If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
Selection Process:
- Apply and complete the screening questions.
- Complete the AI interview for this role to get your expertise in front of the client.
- Profile review.
- Onboarding to get set up by the Talent Ops team.