Subject Matter Expert (SME) : AI Training, Evaluation & Benchmarking at INNOVALANCE LEARNING SYSTEMS | Torre
Subject Matter Expert (SME) : AI Training, Evaluation & Benchmarking
Report

Subject Matter Expert (SME) : AI Training, Evaluation & Benchmarking

Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Freelance
Recurrent
Provide your expected compensation while applying
location_on
Remote (anywhere)
Match
skeleton-gauges
You have opted out of job matches in .
To undo this, go to the 'Skills and Interests' section of your preferences.
Review preferences
Shared by
Emma of Torre.ai
about 1 month ago

Requirements and responsibilities


INNOVALANCE LEARNING SYSTEMS is seeking highly qualified Subject Matter Experts (SMEs) with strong academic and research backgrounds to support AI training, evaluation, benchmarking, data annotation, question generation, answer validation, and reasoning review projects. The ideal candidates will possess deep domain expertise, research experience, and a proven track record of academic excellence.Subject Categories#MathematicsMathematics (Coding)Mathematics (Non-Coding)#PhysicsPhysics (Coding)Physics (Non-Coding)#ChemistryChemistry (Coding)Chemistry (Non-Coding)#BiologyBiology (Coding)Biology (Non-Coding)#EngineeringEngineering (Coding)Engineering (Non-Coding)Key Responsibilities:Evaluate and validate AI-generated responses for accuracy, completeness, and reasoning quality.Develop, review, and annotate domain-specific datasets and content.Create and assess complex subject-specific questions and solutions.Perform benchmarking and quality evaluation of AI models.Review AI-generated reasoning and provide expert feedback.Document findings and maintain quality standards throughout project execution.Required QualificationsMaster's Degree or PhD in Mathematics, Physics, Chemistry, Biology, Engineering, Computer Science, or a related discipline.Strong academic and research background.Published research papers, journal articles, conference papers, patents, or scholarly publications under the candidate's own name.Demonstrated subject matter expertise in the applied domain.Additional Requirements for Coding CategoriesProficiency in at least one programming language such as Python, C++, Java, MATLAB, R, Julia, or relevant domain-specific tools.Ability to write, review, debug, and evaluate code-based solutions.Experience with algorithmic problem-solving and computational modeling is preferred.Additional Requirements for Non-Coding CategoriesStrong conceptual understanding and analytical skills within the subject area.Ability to evaluate complex theoretical, applied, and research-based content.Preferred QualificationsPrior experience in AI model training, evaluation, benchmarking, or annotation projects.Teaching, research, or industry experience within the relevant domain.Familiarity with Large Language Models (LLMs), Generative AI, and prompt engineering.Interested can share their resumes at anjali.gupta@innovalancelearning.com