You'll shape the future of AI financial agents by designing rigorous, real-world evaluation tasks.
Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Freelance
Recurrent
Compensation
USD40-90/hour
The 'Compensation' is required.
location_on
Remote (for United States residents)
The 'Location' is required.
Shared by
10 days ago
Responsibilities
We're looking for a finance professional to help build realistic evaluation tasks that test how well AI agents handle trading, client advisory, and compliance reasoning.What you'll doDesign authentic evaluation scenarios simulating real securities/commodities trading, advisory, and compliance workSource and curate supporting materials — market data, client docs, regulatory referencesDefine and justify correct market/advisory decisions with clear compliance rationaleAuthor detailed 35+ item rubrics to grade agent performance on judgment, compliance sensitivity, and communicationEnsure tasks reflect true day-to-day complexity, not simplified textbook scenariosPartner with technical teams to refine benchmarking standardsWhat we're looking forActive Series 7/63 (or international equivalent)4+ years at a brokerage, bank, or trading platform with compliance-heavy workflowsDirect trade execution and client advisory experience in securities/commoditiesStrong ability to interpret market data, technical docs, and regulatory materialsExcellent written/verbal communication skillsExperience designing tasks or grading rubrics for real-world financial opsComfortable working remotely and independently