Business Intelligence Analyst I – AI & Model Monitoring
General Summary
We're looking for a Business Intelligence Analyst I – AI & Model Monitoring to help establish and scale a new model governance capability within our Finance Analytics organization. This is a unique opportunity to join at the ground level and play a critical role in designing how we monitor, measure, and communicate machine learning model performance across the business.
Principal Duties And Responsibilities
Develop and automate monitoring dashboards and reports that surface model health metrics (e.g., accuracy degradation, input/output drift, data quality anomalies) for review by leadership and model owners.
Execute quantitative monitoring tests such as back-testing, benchmarking, sensitivity analysis, and statistical threshold checks on production model outputs as defined by the monitoring framework.
Profile and analyze incoming data sources to evaluate data quality, completeness, and suitability for ongoing model inference and monitoring.
Document monitoring methodologies, assumptions, and alert configurations to ensure reproducibility and auditability in alignment with enterprise model risk governance.
Track and report on monitoring findings, including drift alerts, performance degradation events, and data quality issues, escalating to the director/manager when intervention or model recalibration is warranted.
Work directly with model owners and internal customers to refine monitoring requirements, validate thresholds, and ensure outputs align with business expectations.
Job Specifications
Bachelor's degree preferred (Data Science, Statistics, Computer Science, Mathematics, or related field) and/or equivalent experience
2+ years of relevant analytics experience, with demonstrated ability to write and maintain Python code for data analysis and automation
Proficiency in Python (required) — including libraries such as pandas, numpy, scipy, and visualization libraries (matplotlib, plotly, or similar)
Proficiency in SQL for data extraction and validation
Experience with or strong interest in Databricks (notebooks, jobs, Delta tables, Unity Catalog) — direct experience preferred but not required
Familiarity with BI/visualization tools (Tableau, Power BI, or equivalent) for presenting monitoring outputs
Benefits
Award-winning culture
Inclusion and diversity as a priority
Performance Based Incentive Plans
Competitive benefits package that includes:
Health, Vision, Dental
Short & Long-Term Disability
Generous PTO (including paid time to volunteer!)
Up to 9.5% 401(k) employer contribution
Mental health support
Career advancement opportunities
Student loan repayment options
Tuition reimbursement
Flexible work environments
All the benefits listed above are subject to the terms of their individual Plans.
About the Role
With 10,000 employees helping more than 39 million people worldwide, every role at Unum is meaningful and impacts the lives of our customers. Whether you’re directly supporting a growing family, or developing online tools to help navigate a difficult loss, customers are counting on the combined talents of our entire team.
Qualifications
The ideal candidate is comfortable navigating ambiguity, collaborating across teams, and proactively driving work forward. Python is the primary coding language for this team, making strong Python proficiency essential. Experience with Databricks, SQL, cloud-based analytics environments, and data visualization tools is highly valued.
Skills
If you're excited about AI, analytics, and building something new while working alongside a talented team of data professionals, we'd love to hear from you.
Pay
The base salary range for applicants for this position is listed below. Unless actual salary is indicated above in the job description, actual pay will be based on skill, geographical location and experience.
- $60,500.00-$123,400.00
Schedule
Not specified