Senior Director, AP Spanish Language and Spanish Literature Assessment Generalist, Curriculum and Assessment
Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).
About the Team
The AP Curriculum and Assessment Team at College Board (125+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 43 courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level.
AP’s course teams comprised of educators and disciplinary experts ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills. AP leads in strategic use of AI to expand student access, strengthen instructional design and professional support, and enhance assessment creation and exam analysis.
The English, World Languages, and Arts department, which includes English Literature, English Language, Spanish Language, Italian Language, French Language, German Language, Chinese Language, Japanese Language, Latin, Music Theory, Spanish Literature, and Art and Design is currently made up of 28 people supporting 14 courses in the AP portfolio.
About the Role
As the Senior Director I, AP Spanish Language and Spanish Literature, Assessment Generalist you will be responsible for preserving and improving the quality and validity of the AP Program’s core deliverables within the subject domain: the exam, the course curriculum, and the professional development content. You are also responsible for item development and management from authoring to administration across multiple course titles; training and collaborating with subject-matter experts (SMEs), typically college professors and secondary school teachers.
You will ethically and effectively integrate AI technologies in assessment creation and review, providing leadership and modeling for course experts across multiple course titles. This includes judiciously using AI assisted tools to support fairness, validity, and innovation in AP assessments. You will train SMEs on assessment development protocols, translate between academics and technical experts (psychometricians), and collaborate to develop formative assessment materials and resources to support AP Spanish Language and Spanish Literature teachers worldwide.
You will serve as a point of contact in AP for committees and communities of subject-matter experts and will be responsible for the curriculum and assessment for AP Spanish Language and Spanish Literature, and, in partnership with other AP teams, further the strategic growth of AP Spanish Language and Spanish Literature across the globe. Additionally, you may have the opportunity to present, speak, and moderate dialogue with academic and membership audiences to ensure that ongoing change and improvement within AP courses and exams is understood, accepted, and supported in secondary and post-secondary educational communities.
Responsibilities
- Assessment Development and Scoring (40-50%)
- Serve as an assessment leader for AP Spanish Language and Spanish Literature with primary responsibility for assessment development and final assessment (items and forms) approval.
- Accountable for developing and reviewing content, and providing final program sign-off on test forms across multiple test titles.
- Lead processes for authoring and revising assessment content, including training educator constituents.
- Leverage generative AI to author and/or review assessment content to improve and/or make more efficient assessment processes and outputs.
- Lead the development and management of assessment content (formative and summative) and scoring materials through iterative review stages with multiple internal and external stakeholders.
- Lead the development of assessment forms ensuring alignment with approved curricula and test specifications.
- Lead multiple face-to-face, weekend meetings, and virtual meetings annually with the AP Spanish Language and Spanish Literature Test Development Committees.
- Train and directly supervise Test Development Committee members as content development contributors and reviewers.
- Lead the successful scoring of student responses for AP Spanish Language and Spanish Literature Exams at the annual scoring event (the “AP Reading”) and produce AP Reading publications materials for teacher and student use.
- Assessment Quality and Process (25-30%)
- Contribute to current research and best practices in assessment, and engage regularly with AP Curriculum & Assessment colleagues to align on standards and shared principles.
- Provide functional leadership of cross-subject assessment workstreams to ensure consistency and leverage efficiencies.
- Provide formal training and informal mentoring to other Course Experts within AP Spanish Language and Spanish Literature.
- Develop strong efficiencies in item development through well-defined task models, item development training and processes, and effective use of generative AI.
- Lead initiatives to refine and improve question task models as well as exam design in collaboration with AP Curriculum & Assessment leaders.
- Monitor exam validity, security, reliability, fairness, and quality, as well as reader reliability in accordance with established Program thresholds.
- Identify areas for improvement and lead targeted initiatives to enhance assessment quality.
- Collaborate with psychometrics and AP Curriculum & Assessment staff to establish fair, reliable, and valid cut scores for AP Spanish Language and Spanish Literature exams.
- Staff Development and Capacity Building (25-30%)
- Train and support course experts in assessment development practices, including quality, validity, fairness, and use of generative AI.
- Mentor team members in effectively facilitating test development committees and working with external stakeholders.
- Course Development and Program Support (0-10%)
- Refine and improve AP Spanish Language and Spanish Literature Course Framework to ensure clear and explicit learning outcomes aligned with strategic priorities.
- Collaborate with AP teams to support the development of new products designed to address unmet teacher instructional needs.
Requirements
- A Master’s degree in Spanish Language, Spanish Literature or a directly related discipline (required); a doctorate in the discipline is strongly preferred.
- Native to near-native fluency in Spanish (required).
- Expertise in Spanish Language or Spanish Literature with at least 10 years of experience in standardized assessment development or related work; experience with digital assessment and teaching preferred.
- Strong oral and written communication skills, with solid technical proficiency and a customer-focused mindset.
- Excellent organizational and planning skills, with the ability to manage multiple tasks and maintain close attention to detail, including proofreading.
- Demonstrated ability to implement processes and procedures, manage project plans and schedules, and maintain tracking documentation.
- Strong interpersonal and collaboration skills, with the ability to work effectively across all levels, and engage in giving and receiving constructive feedback.
- Ability to travel 6-8 times per year, plus up to two additional weeks for the AP Reading; must be eligible to work in the United States.
- A passion for expanding educational and career opportunities and mission-driven work.
- Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions.
- Clear and concise communication skills, written and verbal.
- A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving.
- A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning and user input.
- A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.