OverviewLILT is building a global network of domain experts to support high-quality AI evaluation across training, benchmarking, red-teaming, and ongoing model optimization. We are seeking legal and compliance professionals to contribute expert judgment to human-in-the-loop AI evaluation workflows used by leading enterprises and governments.This role is designed for professionals who understand how legal and regulatory language is used in real-world contexts and who can apply that expertise to evaluate, assess, and improve multilingual AI systems.Your contribution of expertise will directly influence our multilingual AI model’s quality, safety, and deployment readiness.This role includes two distinct expert tracks, based on experience level and scope of responsibility.Track A: Legal & Compliance AI RaterRaters execute structured evaluation tasks using clearly defined rubrics and instructions.ResponsibilitiesEvaluate AI outputs related to legal and compliance contentPerform structured scoring, comparison, classification, and judgment tasksAssess accuracy, relevance, completeness, risk, and alignment with legal normsIdentify hallucinations, ambiguity, unsafe guidance, or misleading outputsApply domain-specific guidelines consistently across tasksIdeal BackgroundLegal practitioner, compliance professional, legal analyst, or policy specialistExperience interpreting statutes, regulations, contracts, policies, or legal guidanceStrong attention to detail and comfort working with structured evaluation criteriaTrack B: Legal & Compliance AI Evaluator (Senior Track)Evaluators provide higher-level domain oversight and help shape how evaluation is done.ResponsibilitiesValidate and refine evaluation rubrics and edge-case handlingPerform adjudication where raters disagreeConduct error analysis and qualitative reviews of model behaviorPartner with LILT research, product, and customer teams on evaluation designSupport red-teaming, risk analysis, and model readiness assessmentsIdeal BackgroundSenior legal professional, compliance lead, regulatory specialist, or legal SMEExperience defining standards, reviewing complex edge cases, or advising on riskComfort explaining nuanced legal reasoning clearly and preciselyEvaluation Focus & RequirementsTypes of AI Evaluation WorkDepending on project demands, work may include:Legal and regulatory content evaluationPolicy interpretation and compliance assessmentBenchmarking and comparative model analysisRed-teaming and safety evaluationOngoing model monitoring and regression testingWhat We Look ForDeep domain expertise in law, compliance, or regulatory environmentsStrong judgment and ability to apply criteria consistentlyComfort working with structured evaluation workflowsAbility to explain reasoning clearly, especially in ambiguous casesReliability, professionalism, and respect for quality standardsEngagement ModelContract-based, flexible participationProject-based work with clear expectations and timelinesOpportunities for recurring work based on performance and demandCompensation communicated upfront per project or task typeWhy This Work MattersYour expertise helps ensure that AI systems:Handle legal and compliance content responsiblyMeet enterprise and regulatory expectationsAre safer, more accurate, and more trustworthy across languagesLanguage RequirementsNative or professional fluency in one or more supported languages is requiredEnglish fluency is required for guidelines, feedback, and collaborationLILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
