Responsibilities
- Analyze and develop informed perspectives on large language model behavior, response quality, reasoning, and AI agent performance.
- Research model evaluation methods, interpretability, post-training approaches, and emerging AI capabilities.
- Develop technical proposals, research briefs, presentations, and client-facing materials.
- Translate complex AI research findings into clear, practical recommendations for technical audiences.
- Collaborate with sales, research, and technical teams to develop data-driven client engagement strategies.
- Participate in technical discussions with AI researchers and help identify their data, evaluation, and experimentation needs.
- Contribute to building and scaling a research-focused client engagement function.
- Use Python and modern AI development tools to support research, analysis, and experimentation where appropriate.
Role context
- FULL_TIME
Additional requirements
- At least 1 year of hands-on experience in model behavior, AI interpretability, model evaluation, or related research. Candidates with shorter but directly relevant frontier AI lab experience may also be considered.
- Experience working at a frontier AI lab, emerging AI research lab, or AI evaluation/data company.
- Practical experience studying model behavior, answer quality, post-training, evaluation methods, or interpretability.
- Strong technical writing and presentation skills, including the ability to explain complex research concepts to external audiences.
- Ability to develop clear, well-supported opinions about what makes AI models effective or ineffective for different users and applications.
- Strong analytical thinking, research skills, and communication abilities.
- Ability to work on-site five days per week at the San Francisco office.
- Preferred qualifications: Experience contributing to AI benchmarks, datasets, evaluation projects, or expert/human annotation programs.
- Preferred qualifications: Familiarity with Python, LLMs, AI agents, model evaluation, and interpretability techniques.
- Preferred qualifications: Experience with AI research, machine learning, computer science, data analytics, statistics, or economics.
- Preferred qualifications: A degree in Computer Science, Machine Learning, Data Analytics, Statistics, Economics, or a related technical field, or equivalent practical experience.
- Preferred qualifications: Familiarity with tools such as Claude Code or Codex.
Benefits
- Base salary: $200,000–$300,000, depending on experience and qualifications.
- On-target earnings (OTE): $250,000–$500,000.
- Competitive equity opportunity.
- Relocation support for qualified candidates.
- Opportunity to help build a new function within a rapidly growing AI-focused organization.
- Direct exposure to advanced AI research, model evaluation, and frontier AI development.
- Work Environment
- This is a full-time, on-site position based in the San Francisco Financial District. Candidates must be available to work from the office Monday through Friday.
- Equal Employment Opportunity