Senior Director I, AP Computer Science and Cyber Generalist, Curriculum and Assessment

About the Team

The AP Curriculum and Assessment Team at College Board (125+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 43 courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level. AP’s course teams, comprised of educators and disciplinary experts, ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills. AP leads in strategic use of AI to expand student access, strengthen instructional design and professional support, and enhance assessment creation and exam analysis.

The Math and Computer Science department, which includes computer science, precalculus, calculus, and statistics, is currently made up of 11 people supporting 6 courses in the AP portfolio.

About the Opportunity

As the Senior Director I, AP Computer Science and Cyber Generalist, Curriculum Assessment, you will be responsible for preserving and improving the quality and validity of the AP Program’s core deliverables within the subject domain: the exam, the course curriculum, and the professional development content. You will also be responsible for item development and management from authoring to administration across multiple course titles; training and collaborating with subject-matter experts (SMEs), typically college professors and secondary school teachers. You will ethically and effectively integrate AI technologies in assessment creation and review, providing leadership and modeling for course experts across multiple course titles. This includes judiciously using AI-assisted tools to support fairness, validity, and innovation in AP assessments.

You will train SMEs on assessment development protocols, translate between academics and technical experts (psychometricians), and collaborate to develop formative assessment materials and resources to support AP Computer Science and Cyber teachers worldwide. You will serve as a point of contact in AP for committees and communities of subject-matter experts and will be responsible for the curriculum and assessment for AP Computer Science and Cyber, and, in partnership with other AP teams, further the strategic growth of AP Computer Science and Cyber across the globe.

Additionally, you may have the opportunity to present, speak, and moderate dialogue with academic and membership audiences to ensure that ongoing change and improvement within AP courses and exams is understood, accepted, and supported in secondary and post-secondary educational communities.

Responsibilities

• Assessment Development and Scoring (40-50%):
  • Serve as an assessment leader for AP Computer Science and Cyber, with primary responsibility for assessment development and final assessment (items and forms) approval.
  • Independently lead processes for authoring and revising assessment content, including training educator constituents.
  • Leverage generative AI to author and/or review assessment content to improve and/or make more efficient assessment processes and outputs.
  • Lead the development and management of assessment content and scoring materials through iterative review stages with multiple stakeholders.
  • Lead the development of assessment forms, ensuring alignment with approved curricula and test specifications.
  • Lead meetings with Test Development Committees, strategize agendas, and resolve post-meeting item content edits.
  • Train and supervise Test Development Committee members in content development and review.
  • Lead the scoring of student responses at the annual AP Reading and produce publications materials.
• Assessment Quality and Process (25-30%):
  • Contribute to research and best practices in assessment, aligning with AP standards.
  • Provide functional leadership for cross-subject assessment workstreams.
  • Train and mentor Course Experts within the AP Computer Science and Cyber team.
  • Develop efficiencies in item development through task models, training, and AI integration.
  • Lead initiatives to refine question task models and exam design in collaboration with AP leaders.
  • Monitor exam validity, security, reliability, fairness, and quality.
  • Collaborate on establishing fair, reliable, and valid cut scores.
• Staff Development and Capacity Building (25-30%):
  • Train course experts in assessment development practices, including AI use.
  • Mentor team members in facilitating test development committees and stakeholder engagement.
• Course Development and Program Support (0-10%):
  • Refine AP Computer Science and Cyber Course Frameworks to align with strategic priorities.
  • Collaborate on developing new products to address teacher instructional needs.

Qualifications

• Master’s degree in computer science, cybersecurity, or networking (doctorate strongly preferred)
• Fluency in Java
• 10+ years of experience in standardized assessment development or related work
• Experience with digital assessment and teaching preferred
• Strong oral and written communication skills
• Excellent organizational and planning skills
• Ability to manage multiple tasks and maintain attention to detail
• Strong interpersonal and collaboration skills
• Ability to travel 6-8 times per year, plus up to two additional weeks for the AP Reading
• Authorization to work in the United States

Skills

• Passion for expanding educational and career opportunities
• Curiosity and enthusiasm for emerging technologies, especially AI
• Clear and concise communication skills
• Learner's mindset and commitment to growth
• Drive for impact and excellence
• Collaborative and empathetic approach

Location: Remote (option for hybrid in CB offices: Tuesday and Wednesday in office)

Role Type: Full-time

Travel: Required for business purposes and AP Reading