Senior Substance Use Program Evaluator

About the role

As a member of the Performance Improvement and Evaluation team, this Senior Substance Use Program Evaluator helps lead a team focused on substance use evaluation and performance improvement projects and initiatives within the Behavioral Health Services (BHS) department. This team partners with executive-level staff, subject matter experts, and external stakeholders to develop plans for evaluations and analyses that reflect national standards and best practices. The position manages and coordinates complex behavioral health evaluation and performance improvement initiatives throughout their life cycle by defining project objectives, developing evaluation methodologies, monitoring implementation, measuring program effectiveness and efficiency, identifying opportunities for improvement, and documenting evaluation processes. The position coordinates with executive leadership, subject matter experts, internal divisions, external partners, and other stakeholders to support cross-functional program outcomes and ensure evaluation activities align with agency priorities and strategic objectives.

Responsibilities

• Program Evaluation and Data Analytics: Plan and implement complex evaluations and analyses for substance use programs, projects, and policies. Develop evaluation frameworks, performance metrics, utilization measures, and data collection tools to assess program effectiveness and support agency priorities. Coordinate the collection, organization, and analysis of complex data and research to inform evaluations and performance improvement. Interpret applicable policies, procedures, rules, regulations, and standards to ensure evaluations and measures are compliant and meaningful. Provide technical assistance to management, staff, and other stakeholders throughout the evaluation process. (45%)
• Performance Monitoring and Utilization Management: Develop methods and tools to measure the efficiency and effectiveness of agency initiatives consistent with program requirements; other applicable rules, policies, and procedures; and the agency’s strategic objectives. Design reports, dashboards and other tools to support routine performance monitoring and utilization management. (20%)
• Documentation and Reporting: Develop, maintain, and continuously improve standards, methodologies, templates, documentation, and guidance to promote consistency across projects and support long-term program monitoring. Coordinate the collection, organization, analysis, and preparation of materials in response to requests for routine and ad-hoc information and reports. Communicate project status, risks, and performance trends to leadership. (15%)
• Stakeholder Engagement and Support: Coordinate communications with internal staff, external partners, providers, and leadership regarding substance use evaluations and analyses. Collaborate with internal and external stakeholders to translate data into actionable insights to optimize program performance, recommending appropriate changes to programs and processes as necessary. Provide consultative services to program staff regarding evaluation methodologies and performance improvement. (15%)
• Other: Perform other duties as assigned. (5%)

Requirements

• At least two years of experience in a field related to public health, substance use programs, or data and evaluation.
• Graduation from an accredited four-year college or university with major coursework in a relevant field such as public health, public policy, health administration, behavioral/social sciences, statistics, or a related field.

Knowledge, Skills and Abilities (KSAs)

• Knowledge of:
  • Advanced knowledge of quantitative and qualitative research techniques and their application in program evaluation and improvement.
  • Expertise in statistical analysis processes and methodologies.
  • Knowledge of program management principles and practices.
• Skill in:
  • Proficient in identifying and applying metrics or indicators of program performance to ensure continuous improvement.
  • Highly skilled in using computers and applicable software for data analysis, report preparation, and program management.
  • Strong analytical skills to collect, organize, analyze, and interpret complex data, often coordinating multiple concurrent initiatives.
  • Strong report-writing skills for clear and concise communication of findings and recommendations to both technical and non-technical audiences.
  • Excellent communication skills, both verbal and written, to effectively convey information and provide guidance to both technical and non-technical audiences.
  • Skill in developing performance monitoring tools and dashboards.
• Ability to:
  • Expert ability in developing, evaluating, and interpreting policies and procedures to ensure program compliance and effectiveness.
  • Ability to exercise sound judgment when evaluating complex program issues.
  • Leadership ability to serve as a lead worker, providing direction and oversight to other staff members.

Benefits

• 100% paid employee health insurance for full-time eligible employees
• Defined benefit pension plan
• Generous time off benefits
• Numerous opportunities for career advancement

Pay

$5,797.66 – $9,508.25 monthly

Schedule

Day shift; eligible for telework; up to 5% travel