Subject Matter Expert (SME) : AI Training, Evaluation & Benchmarking at INNOVALANCE LEARNING SYSTEMS | Torre
Subject Matter Expert (SME) : AI Training, Evaluation & Benchmarking
Report
warning

Heads-up

The job you’re trying to post already exists in Torre:

Subject Matter Expert (SME) : AI Training, Evaluation & Benchmarking

You'll shape the future of AI by applying your deep scientific expertise to evaluate and refine models.
Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Freelance
Recurrent
Provide your expected compensation while applying
location_on
Remote (anywhere)
Match
skeleton-gauges
You have opted out of job matches in .
To undo this, go to the 'Skills and Interests' section of your preferences.
Review preferences
Shared by
Emma of Torre.ai
3 days ago

Requirements and responsibilities


INNOVALANCE LEARNING SYSTEMS is seeking highly qualified Subject Matter Experts (SMEs) with strong academic and research backgrounds to support AI training, evaluation, benchmarking, data annotation, question generation, answer validation, and reasoning review projects. The ideal candidates will possess deep domain expertise, research experience, and a proven track record of academic excellence.Subject Categories#MathematicsMathematics (Coding)Mathematics (Non-Coding)#PhysicsPhysics (Coding)Physics (Non-Coding)#ChemistryChemistry (Coding)Chemistry (Non-Coding)#BiologyBiology (Coding)Biology (Non-Coding)#EngineeringEngineering (Coding)Engineering (Non-Coding)Key Responsibilities:Evaluate and validate AI-generated responses for accuracy, completeness, and reasoning quality.Develop, review, and annotate domain-specific datasets and content.Create and assess complex subject-specific questions and solutions.Perform benchmarking and quality evaluation of AI models.Review AI-generated reasoning and provide expert feedback.Document findings and maintain quality standards throughout project execution.Required QualificationsMaster's Degree or PhD in Mathematics, Physics, Chemistry, Biology, Engineering, Computer Science, or a related discipline.Strong academic and research background.Published research papers, journal articles, conference papers, patents, or scholarly publications under the candidate's own name.Demonstrated subject matter expertise in the applied domain.Additional Requirements for Coding CategoriesProficiency in at least one programming language such as Python, C++, Java, MATLAB, R, Julia, or relevant domain-specific tools.Ability to write, review, debug, and evaluate code-based solutions.Experience with algorithmic problem-solving and computational modeling is preferred.Additional Requirements for Non-Coding CategoriesStrong conceptual understanding and analytical skills within the subject area.Ability to evaluate complex theoretical, applied, and research-based content.Preferred QualificationsPrior experience in AI model training, evaluation, benchmarking, or annotation projects.Teaching, research, or industry experience within the relevant domain.Familiarity with Large Language Models (LLMs), Generative AI, and prompt engineering.Interested can share their resumes at anjali.gupta@innovalancelearning.com
Optionally, you can add more information later (benefits, pre-screening questions, etc.)
check_circle

Payment confirmed

A member of the Torre team will contact you shortly

In the meantime, continue adding information to your job opening.