Evaluation Specialist Sr

Supporting the VHA AI Education Hub, you will design and implement comprehensive evaluation systems that measure the adoption, impact, and effectiveness of AI education resources across the Veterans Health Administration. This high-visibility role directly informs how one of the largest integrated healthcare systems in the world invests in and expands its AI education strategy.

Responsibilities

• Design and implement end-to-end evaluation systems to assess program impact, resource adoption, and learning outcomes associated with the VHA AI Education Hub's initiatives.
• Apply a mixed-methods approach — including content analysis, quantitative tracking, surveys, focus groups, and structured interviews — to generate robust, actionable insights on program performance.
• Oversee the generation, formatting, and communication of performance reports, ensuring findings are accurately translated into strategic recommendations and integrated into current program strategies.
• Meet regularly with Government stakeholders to discuss evaluation progress, present findings, propose new assessment initiatives, and help establish organizational priorities for the AI Education Hub.
• Develop data-driven sustainment and expansion recommendations that guide the long-term growth of AI education resources, drawing on evaluation evidence and emerging federal healthcare workforce needs.
• Conduct secondary research and environmental scans to benchmark the VHA AI Education Hub against comparable federal, healthcare, and AI literacy programs, informing continuous improvement efforts.

Requirements

• Minimum 5 years of experience designing and implementing program evaluation systems, with demonstrated expertise in both quantitative and qualitative assessment methodologies.
• Bachelor's degree (BA/BS) in Evaluation, Public Health, Public Policy, Social Sciences, Education, or a related field.
• Prior experience supporting federal agency clients — preferably within VA, VHA, DoD, or another federal health or workforce development context — with the ability to navigate government stakeholder environments effectively.
• Ability to obtain and maintain VA network access and meet all VHA personnel security requirements, including applicable background investigation requirements for contractor personnel.
• Must be legally authorized to work in the United States without sponsorship, now or in the future, in compliance with federal contractor employment eligibility requirements.
• Demonstrated proficiency with evaluation tools and methods including survey design, focus group facilitation, structured interviews, and secondary/desk research, with experience translating findings into executive-level reports and strategic recommendations.

Qualifications

• Experience evaluating technology adoption, digital literacy, or AI/emerging technology training programs within a federal or large healthcare organization.
• Familiarity with VHA or broader VA organizational structures, workforce development priorities, or health informatics initiatives.
• Proficiency with data visualization or reporting tools (e.g., Power BI, Tableau, or equivalent) to communicate evaluation findings to non-technical government audiences.
• Master's degree in Evaluation, Public Health, Organizational Development, or a related discipline.
• Knowledge of federal performance management frameworks such as OMB guidance, GPRA/GPRAMA, or HHS/VA evaluation policies that govern program assessment and reporting.

About Aptive

Aptive partners with federal agencies to achieve their missions through improved performance, streamlined operations and enhanced service delivery. Based in Alexandria, Virginia, we support more than a dozen agencies including Veterans Affairs, Transportation, Defense, Homeland Security and the National Science Foundation. We specialize in applying technology, creativity and human-centered services to optimize mission delivery and improve experiences for millions of people who count on government services every day.

Founded: 2012. Employees: 300+ nationwide.