AI Model Risk Validation Specialist
About the role
Serve as the independent validator of AI Systems, responsible for technical assessment, model risk evaluation, and ongoing monitoring of AI/ML models across The Mutual Group and its member insurance carriers. This is a highly hands‑on individual contributor role focused exclusively on AI Systems, with emphasis on predictive models impacting underwriting, claims, and decision‑making. The role supports the AIS Program by providing objective, technical validation input into governance and approval decisions.
Accountabilities
- Model Validation (Core Responsibility): Perform independent validation of AI/ML models, including model design, methodology, and assumptions; training and test data quality and representativeness; performance metrics, thresholds, and benchmarking; review vendor‑provided FactSheets and technical documentation for completeness and accuracy.
- Risk Assessment: Evaluate key model risks such as bias and fairness, explainability and interpretability, model limitations and edge cases; assess alignment with NAIC expectations and model risk management practices; identify gaps and recommend risk mitigation strategies.
- Governance Integration: Provide independent validation input into AI governance decisions; support the AIS / Security Governance Team by contributing technical risk perspectives during AI system reviews; act as a second‑line reviewer to challenge assumptions and strengthen decision‑making.
- Ongoing Monitoring: Lead twice‑annual validation of AI Systems; monitor predictive models for drift, stability, and performance degradation; ensure monitoring practices align with AIS Program requirements; recommend corrective actions when performance or risk thresholds are breached.
- Documentation & Audit Support: Maintain model validation documentation for internal audit and regulatory review; ensure validation results are clearly documented, traceable, and reproducible; support inquiries with technical analysis and evidence.
Qualifications
- 5+ years in data science, model risk management, or AI/ML validation.
- Experience working with predictive models in regulated environments (insurance or financial services preferred).
- Strong understanding of machine learning models, statistical techniques, model evaluation and validation methodologies, bias and fairness concepts, and model lifecycle management.
- Familiarity with NAIC AI Model Bulletin, NIST AI RMF, and model governance and validation standards.
- Ability to translate technical findings into business and risk implications.
Work Arrangement
Employees who live within 30 miles of the TMG home office are expected to follow a hybrid or in‑office schedule. The initial training period may require additional in‑office days.
Pay
Anticipated hiring range: $100,000 – $135,000 annual base salary, depending on experience, qualifications, and geographic location.
Benefits
- Competitive base salary plus incentive plans for eligible team members.
- 401(k) retirement plan with company match up to 6% of eligible salary.
- Free basic life and AD&D, long‑term disability, and short‑term disability insurance.
- Medical, dental, and vision plans.
- Wellness incentives.
- Generous time‑off program including personal, holiday, and volunteer paid time off.
- Flexible work schedules and hybrid/remote options for eligible positions.
- Educational assistance.