For companies:
For professionals:
For everyone:
For developers:
Responsibilities and deliverables
Key Responsibilities:
- Design advanced computer science problems to test AI reasoning and conceptual understanding.
- Create benchmark datasets across core and advanced CS domains.
- Develop clear, step-by-step reference solutions with rigorous logic.
- Evaluate AI-generated responses for correctness, reasoning quality, completeness, and clarity.
- Identify flaws, gaps, assumptions, and edge cases in AI outputs.
- Collaborate with researchers to improve benchmark quality and evaluation standards.
- Provide structured feedback to enhance AI performance in complex problem-solving tasks.
Required Qualifications:
- PhD (completed or pursuing) in Computer Science or a related field.
- Master’s degree with strong research experience may also be considered.
- Strong expertise in one or more of the following areas:
- Algorithms & Data Structures.
- Systems Design.
- Cybersecurity.
- Computer Networks.
- Databases.
- Theory of Computation.
- Operating Systems.
- Distributed Systems.
- Machine Learning / Artificial Intelligence (optional).
- Strong analytical and problem-solving skills across advanced CS domains.
- Ability to design challenging conceptual problems requiring deep reasoning.
- Excellent written communication and structured explanation skills.
- Strong attention to detail for evaluating assumptions, definitions, and solution validity.
Preferred Skills:
- Research publications, academic projects, or prior experience in advanced CS domains.
- Experience in evaluating technical solutions and identifying edge cases.
- Familiarity with AI/LLMs is a plus but not mandatory.
This job post is closed.