Program Manager - Evaluation

About the role

The Program Manager, Evaluation manages a portfolio of evaluation studies that aim to understand the impact of programs and services on patient health outcomes and disparities and use that information to improve services. The Program Manager, Evaluation designs and manages evaluations including development of key evaluation questions, data collection, and analysis plans as well as dissemination of evaluation results to staff and stakeholders, including, as required, local and national funders. The position manages multiple projects and works with the Programs and Services team to support an equity lens and framework for ACCESS. ACCESS is a Network of Federally Qualified Health Centers treating patients on the frontlines of community-based health care.

Responsibilities

• Facilitate relationships between evaluation and program staff and across departments to design, implement, interpret and disseminate evaluation activities as appropriate.
• Collaborate with program leadership to determine key evaluation questions relevant to grant projects and ACCESS evaluation needs.
• Design and manage the execution of credible and feasible evaluations that address identified purposes and questions. This includes:
  • Program conceptualization: development of theory of change, logic models, workflows, and benchmarks.
  • Formative and summative evaluation: Identify quality improvement opportunities and develop recommendations to strengthen program services and organizational operations.
  • Negotiate and manage timelines and document evaluation processes and products
  • Develop and implement processes for data collection and analysis:
    • Develop qualitative and quantitative data collection tools for evaluation, including, but not limited to, interview guides, focus group guides, surveys, etc.
    • Ensure data quality and participate in data integrity review
    • Conduct review of literature to justify appropriate methods to answer evaluation questions and identify assumptions that underlie methodologies and program logic.
    • Monitor and maintain systems for effective participant and data flow for studies, including working with subcontractors to set up data collection and transfer systems and process data as required.
    • Prepare evaluation communication documents for program improvement and dissemination throughout project, including quarterly updates and annual reports.
    • Collaborate with project team and leadership to draft abstracts and scientific papers for presentation & publication.
    • Ensure that all documents associated with current local, state, & federal regulatory guidelines, requirements, laws & research or evaluation protocols are completed in a timely manner.
  • Performs other duties as assigned.

  Requirements

  • Bachelor’s degree in Public Health, Health Administration, Social Sciences, or a related field, with advanced graduate-level coursework supporting evaluation and research initiatives.
  • Developed and conducted program evaluations, research studies, and study coordination activities to assess outcomes and inform strategic decision-making.
  • Applied public health and evaluation frameworks, including RE-AIM, CFIR, developmental evaluation, action learning/research, and other pragmatic evaluation approaches.
  • Designed and implemented qualitative research methods, including focus groups, key informant interviews, and stakeholder feedback processes.
  • Utilized qualitative data analysis software, including NVivo and Atlas.ti, to analyze findings and identify actionable insights.
  • Led quantitative research efforts, including survey development, deployment, data collection, and analysis to