You have opted out of job matches in .
To undo this, go to the 'Skills and Interests' section of your preferences.
Posted 5 days ago
Responsibilities and deliverables
STEM Computational Scientific Software & Evaluation Design: Computational Bayesian Statistics and Applied Mathematics.
Contract Details:
- Hourly contract.
- Remote.
- $70-$100 per hour.
About the Project:
- We are building a large-scale evaluation benchmark for advanced AI reasoning across scientific and engineering domains.
- Our task designers create challenging computational problems that test whether AI systems can use real scientific software tools to solve research-grade problems, from querying simulations and interpreting outputs to designing experimental strategies and recovering hidden information from data.
- This is not a typical annotation or labeling role.
- You will be designing original, graduate-level computational problems grounded in real scientific workflows, calibrating them against frontier AI models, and iterating on problem design until the difficulty is right.
What You Will Do:
- You will design problems that require sophisticated use of domain-specific scientific software libraries.
- Some problems will require computing precise outputs from fully specified setups, testing whether a solver can correctly implement complex multi-step scientific workflows.
- Others will require something harder: designing a sequence of queries or experiments to uncover information that is not directly visible, demanding strategic reasoning about what to measure, how to interpret partial observations, and how to narrow down possibilities efficiently.
- Each task goes through a calibration loop where it is tested against state-of-the-art AI models, and you will refine the problem design until the difficulty hits the target range.
Domains & Tools We Are Hiring For:
- We are especially interested in experts with deep, hands-on experience in Computational Bayesian Statistics and Applied Mathematics.
- Working with libraries across Bayesian statistics, including PyMC, PyStan, PyJAGS, and CmdStanPy; applied mathematics and numerical PDEs, including FEniCS, FEniCSx, DOLFINx, scikit-fem, FiPy, Devito, and Dedalus; computational topology, including GUDHI; or differential algebra, including DACEyPy.
- Experience with MCMC, Bayesian modelling, finite element or finite difference methods, mesh-based numerical modelling, computational topology, differential algebra, or other specialized Python-based computational methods in mathematics and statistics is valuable.
- Candidates do not need experience with all listed packages, but experience with any one of these packages will be highly regarded.
- Experience with other specialized software for the above domain will also be considered.
What Makes a Strong Candidate:
- You have graduate-level expertise (MS or PhD preferred) in the domain listed above, with real hands-on experience using the specific software tools, not just theoretical knowledge of the field.
- You have written code that calls these libraries to solve actual research problems, and you understand where they break, what their edge cases are, and what makes a problem genuinely hard versus superficially complex.
- Beyond domain expertise, the strongest candidates will be able to think like a puzzle designer: constructing problems where the difficulty comes from reasoning strategy rather than brute computation, where there are multiple plausible approaches but only careful analysis reveals the right one, and where surface-level pattern matching will not get you to the answer.
Requirements:
- Graduate-level training in a relevant STEM domain (MS, PhD, or equivalent research experience).
- Demonstrated proficiency with at least one of the listed scientific software libraries, evidenced by research publications, open-source contributions, or professional work.
- Strong Python programming skills: you will be writing problem setups, oracle functions, and solution validators.
- Ability to work independently and iterate on problem designs based on calibration feedback.
- Comfortable working in a Linux/terminal environment with remote compute sandboxes.
- Available for at least 15–20 hours per week.
Nice to Have:
- Experience across multiple listed domains or tools.
- Familiarity with benchmark or evaluation design.
- Background in scientific pedagogy or exam/problem-set design.
- Experience with computational reproducibility and containerized environments.
Equal Opportunity Employer:
- We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms:
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
Optionally, you can add more information later (benefits, pre-screening questions, etc.)