AI Model Risk Validation Specialist

Model Validation (Core Responsibility)

Perform independent validation of AI/ML models, including:

• Model design, methodology, and assumptions
• Training and test data quality and representativeness
• Performance metrics, thresholds, and benchmarking
• Review vendor-provided FactSheets and technical documentation for completeness and accuracy

Risk Assessment

Evaluate key model risks, including:

• Bias and fairness
• Explainability and interpretability
• Model limitations and edge cases
• Assess alignment with: NAIC expectations, model risk management practices
• Identify gaps and recommend risk mitigation strategies

Governance Integration

Provide independent validation input into AI governance decisions

Support the AIS / Security Governance Team by contributing technical risk perspectives during AI system reviews

Act as a second-line reviewer to challenge assumptions and strengthen decision-making

Ongoing Monitoring

Lead twice-annual validation of AI Systems

• Maintain monitoring practices aligned with AIS Program requirements
• Monitor predictive models for: Drift, Stability, Performance degradation
• Recommend corrective actions when performance or risk thresholds are breached

Documentation & Audit Support

Maintain model validation documentation for:

• Internal audit
• Regulatory review

Ensure validation results are:

• Clearly documented
• Traceable and reproducible

Support inquiries with technical analysis and evidence

Qualifications

• 5+ years in data science, model risk management, or AI/ML validation
• Experience working with predictive models in regulated environments (insurance or financial services preferred)
• Strong understanding of:
• Machine learning models and statistical techniques
• Model evaluation and validation methodologies
• Bias and fairness concepts
• Model lifecycle management
• Familiarity with:
• NAIC AI Model Bulletin
• NIST AI RMF
• Model governance and validation standards

Pay Range

Anticipated Hiring Range: $100,000 - $135,000 annual base salary depending on experience, qualifications, and geographic location

Benefits

• Competitive base salary plus incentive plans for eligible team members
• 401(K) retirement plan that includes a company match of up to 6% of your eligible salary
• Free basic life and AD&D, long-term disability and short-term disability insurance
• Medical, dental and vision plans to meet your unique healthcare needs
• Wellness incentives
• Generous time off program that includes personal, holiday and volunteer paid time off
• Flexible work schedules and hybrid/remote options for eligible positions
• Educational assistance

Equal Opportunity Employer

The Mutual Group is an Equal Opportunity Employer. It is our policy to recruit, hire, train and promote individuals in all job classifications without regard to race, color, religion, sex, national origin, age, veteran status, disability, sexual orientation, gender identity or any other characteristic protected by law.