Location: New York, NY, United States | Type: Remote | Country: USDepartmentInformation Technology Job DescriptionServe as the independent validator of AI Systems, responsible for technical assessment, model risk evaluation, and ongoing monitoring of AI/ML models across The Mutual Group and its member insurance carriers. This is a highly hands-on individual contributor role focused exclusively on AI Systems, with emphasis on predictive models impacting underwriting, claims, and decision-making. The role supports the AIS Program by providing objective, technical validation input into governance and approval decisions. Work ArrangementEmployees who live within 30 miles of the TMG home office are expected to follow a hybrid or in-office schedule. The initial training period may require additional in‑office days.AccountabilitiesModel Validation (Core Responsibility)Perform independent validation of AI/ML models, including:Model design, methodology, and assumptionsTraining and test data quality and representativenessPerformance metrics, thresholds, and benchmarkingReview vendor-provided FactSheets and technical documentation for completeness and accuracyRisk AssessmentEvaluate key model risks, including:Bias and fairnessExplainability and interpretabilityModel limitations and edge casesAssess alignment with:NAIC expectationsModel risk management practicesIdentify gaps and recommend risk mitigation strategiesGovernance IntegrationProvide independent validation input into AI governance decisionsSupport the AIS / Security Governance Team by contributing technical risk perspectives during AI system reviewsAct as a second-line reviewer to challenge assumptions and strengthen decision-makingOngoing MonitoringLead twice-annual validation of AI SystemsMonitor predictive models for:DriftStabilityPerformance degradationEnsure monitoring practices align with AIS Program requirementsRecommend corrective actions when performance or risk thresholds are breachedDocumentation & Audit SupportMaintain model validation documentation for:Internal auditRegulatory reviewEnsure validation results are:Clearly documentedTraceable and reproducibleSupport inquiries with technical analysis and evidenceQualifications5+ years in data science, model risk management, or AI/ML validationExperience working with predictive models in regulated environments (insurance or financial services preferred)Strong understanding of:Machine learning models and statistical techniquesModel evaluation and validation methodologiesBias and fairness conceptsModel lifecycle managementFamiliarity with:NAIC AI Model BulletinNIST AI RMFModel governance and validation standardsAbility to translate technical findings into business and risk implicationsPay RangeAnticipated Hiring Range:$100,000 - $135,000 annual base salary depending on experience, qualifications, and geographic locationBenefitsWe are proud to offer our full-time regular employees a robust benefits suite that includes:Competitive base salary plus incentive plans for eligible team members401(K) retirement plan that includes a company match of up to 6% of your eligible salaryFree basic life and AD&D, long-term disability and short-term disability insuranceMedical, dental and vision plans to meet your unique healthcare needsWellness incentivesGenerous time off program that includes personal, holiday and volunteer paid time offFlexible work schedules and hybrid/remote options for eligible positionsEducational assistanceEqual Opportunity EmployerThe Mutual Group is an Equal Opportunity Employer. It is our policy to recruit, hire, train and promote individuals in all job classifications without regard to race, color, religion, sex, national origin, age, veteran status, disability, sexual orientation, gender identity or any other characteristic protected by law.Know Your Rights: Workplace Discrimination is IllegalYour Rights Under USERRAApplicants requiring a reasonable accommodation due to a disability at any stage of the employment application process should contactTalent@themutualgroup.com. Employment VerificationThe Mutual Group participates in theE-Verifyprogram and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S. You are protected fromemployment discriminationbased on your citizenship status and national origin. E-Verify Program OverviewE-Verify Participation PosterAll offers of employment are contingent upon the successful completion of a background check. TMG
19 days ago