Manager, Speaking Test Development

We need to output HTML fragment with sections: About the role? Actually we have Company Description, Job Description, Qualifications, etc. We need to use

for section headings like About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. We must not repeat job title as heading. We need to include sections only when posting has real specific content. We have content: Company Description (maybe "About the role"? Actually company description is about organization). Could map to "About the role" or maybe "About the organization". The instruction says use headings e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. So we can choose appropriate headings based on content. We have: - Company Description: description of CAL, mission, location, work arrangement, restrictions, no relocation compensation, not open to certain states. - Job Description: details of Manager, Speaking Test Development responsibilities. - Qualifications: Education and Experience, Knowledge, Skills, and Abilities, ideal candidate traits. - Travel Requirements: occasional travel 1-3 times per year. - Additional Information: Compensation: Minimum Salary: $77,250; Benefits eligible Full-time; Physical demands; ADA; etc. Also EEO statement (boilerplate to remove). Also "Additional Information" includes compensation and benefits. We need to remove boilerplate: cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, application instructions. So we should drop the EEO statement, the "Please submit Resume and Cover Letter when applying***", the "Additional Information" about physical demands maybe keep? It's substantive? It describes physical demands; could be part of Responsibilities? Might be considered boilerplate? It's not typical boilerplate but it's about physical demands. The instruction says remove cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, and application instructions. Physical demands is not those; we can keep if relevant. However we have no specific section for Physical demands; we could include under Responsibilities or maybe under a separate section like "Working Conditions". But allowed headings list does not include Working Conditions. We could incorporate into Responsibilities or maybe under "About the role". Probably better to include under Responsibilities as a bullet? But it's not a duty. Could be omitted? The instruction says preserve ALL substantive information; do NOT invent or summarize away detail. So we need to keep physical demands info. Could place under a

after Responsibilities. We also have compensation: Minimum Salary: $77,250; Benefits eligible Full-time. So we need a Pay section (since we have salary) and Benefits section (since we have benefits). Schedule? Not mentioned besides remote/hybrid; we have work arrangement: employee may choose to work in preferred combination of in person at D.C. office in a hoteling capacity, or remotely (up to 100% remote). That's schedule/location info. Could be under Schedule? Or maybe under About the role. Since we have a Schedule heading allowed, we could put that info there. However schedule usually refers to hours; but we can treat as work arrangement. The instruction: "never create Pay/Schedule/Benefits sections unless the posting actually states them." We have Pay (salary), Benefits (eligible full-time), and Schedule? The posting mentions work arrangement (remote/hybrid) but not specific schedule like full-time/part-time hours. It does say Benefits eligible Full-time, implying full-time schedule. So we could include Schedule as full-time? Might be okay. But we need to avoid filler like "not specified". We have full-time indicated. So we can include Schedule: Full-time (with remote/hybrid option). That seems substantive. Thus sections: About the role (company description and work arrangement?), Responsibilities (job description duties), Qualifications (education/experience, knowledge/skills/abilities, ideal candidate), Benefits, Pay, Schedule, Travel Requirements? Travel is not in allowed headings but we could include under Responsibilities or maybe as its own section if we treat as "Travel". Not in list; better to incorporate into Responsibilities as a bullet. We must not create headings with filler. So we will output:

About the role

... company description ...

Responsibilities

• ... list of duties ...

Qualifications

... education/experience ...

• ... knowledge, skills, abilities ...

... ideal candidate ...

Benefits

Benefits eligible Full-time.

Pay

Minimum Salary: $77,250.

Schedule

Full-time position with the option to work remotely up to 100% or in a hoteling capacity at the D.C. office.

We need to ensure we preserve all substantive information: include mission, location, work arrangement, restrictions (not open to candidates residing in certain states), no relocation compensation. Also include travel requirements (1-3 times per year). Also include physical demands (communicate, sit/stand 50%, constant computer use, ADA compliance). Also include that the position is not open to candidates residing in NY, NJ, PA, TX, CA, or US Territories. Also mention that CAL does not compensate or reimburse relocation expenses. We need to embed those in appropriate sections. Let's craft About the role paragraph: Include CAL description, mission, location, work arrangement, restrictions, no relocation compensation, not open to certain states. Responsibilities: need to list duties from Job Description and also maybe include collaboration with Manager, Rater Training, etc. We'll extract bullet points. Qualifications: Education and Experience, Knowledge, Skills, and Abilities, ideal candidate traits. Benefits: Benefits eligible Full-time. Pay: Minimum Salary: $77,250. Schedule: Full-time with remote/hybrid option. Travel: maybe include under Responsibilities as a bullet: "Requires occasional travel (1-3 times per year)." Physical demands: maybe include under Responsibilities as a bullet or under About the role? Could be under Responsibilities as "Physical demands: ..." but it's not a duty. Could be under About the role as part of working conditions. We'll add a paragraph under About the role after description? Or maybe under Responsibilities as a note. I'll add a separate paragraph under About the role: "Physical demands: ..." but that may be mixing. Better to add a separate section? Not allowed headings. Could add a

after Responsibilities titled "Working Conditions"? Not in list. But we can embed within Responsibilities as a bullet: "Meet physical demands: regularly communicate, sit or stand stationary 50% of time, constant computer use; ADA compliant." That preserves info. Also need to include that the position is not open to candidates residing in certain states and no relocation compensation. That can go in About the role. Now we need to ensure we don't repeat job title as heading. We'll not. We must not include duplicated lines. We'll consolidate. Now produce HTML fragment. Let's draft. About the role paragraph: "The Center for Applied Linguistics (CAL) is a nonprofit organization promoting access, equity and mutual understanding for linguistically and culturally diverse people around the world. CAL’s mission is to promote language learning and cultural understanding by serving as a trusted source for research, resources, and policy analysis, seeking solutions to issues involving language and culture as they relate to access and equity in education and society globally. Located in Washington, D.C., this position offers a flexible work arrangement: employees may choose to work in a hoteling capacity at the D.C. office or remotely up to 100% of the time. CAL does not provide relocation reimbursement. The role is not open to candidates residing in New York, New Jersey, Pennsylvania, Texas, California, or any U.S. Territories." That covers. Responsibilities: list bullets from Job Description. We need to capture all duties: - Oversee development of Speaking test items and ancillary materials for WIDA suite assessments (large-scale English language proficiency assessments for multilingual learners grades 1-12). - Review, revise, and approve test items (linguistic content, graphics, scripts, audio files) aligning to WIDA English Language Development Standards Framework, focus on Speaking domain. - Oversee test development process from start to finish. - Develop test refreshment plans, timelines, and procedures. - Provide comprehensive feedback to test developers. - Sign off on test items content at critical points in development process. - Collaborate with Manager, Rater Training to oversee creation of scoring materials for Speaking test. - Manage test development staff who write, review, revise, and select Speaking test items based on item specifications, test maps, and blueprints. - Evaluate test items for appropriate task setup and design, linguistic complexity, grade-level appropriateness, content correctness, universal accessibility, appropriate scaffolding, fairness, sensitivity, adherence to style guides. - Give clear, constructive, timely feedback to test developers on test item text, graphics, layouts using specifications. - Sign off on test item content at end of each phase of item development cycle. - Work in close collaboration with managers and directors across functional teams and partner organizations to coordinate efforts. - Collaborate on production of project plans and timelines for test item development in coordination with client and other vendors; oversee implementation. - Oversee development and revision of item specifications; sign off on revisions. - Oversee creation of training materials to prepare external reviewers. - Ensure test development staff provide content, administrative, technical support for external reviewers. - Lead meetings where stakeholders review content, fairness, grade-appropriateness of test items; ensure stakeholder feedback resolved. - Work with test development staff and audio recording studio to cast actors and produce recordings for Speaking test items; oversee recording sessions and quality monitoring. - Write, review, edit written reports, procedures, foundational documents for internal and external stakeholders. - Update and maintain style guides and item development checklists. - Ensure test development staff follow quality control and test security procedures. - Coordinate, conduct, sign off on quality checks of field test QTI packages and ancillary materials. - Review and update field test functional rules. - Oversee qualitative analysis of Speaking field test responses; report findings to internal teams and external stakeholders. - Conduct research (pilot testing, cognitive lab interviews) in support of test development. - Collaborate on research and development work for scoring materials related to Speaking test, including rubrics, rater training presentations and courses, other scoring guidance. - Support selection of anchor and training responses. - Review score justifications and score appeals, as well as qualifying, recalibration, and validity sets. - Synthesize information from scoring of Speaking tasks for use in future development. - Review test maps, test forms, ancillary documents, test practice items, sample items for public. - Write, review, maintain test and item design plans. - Review and maintain Speaking Test Construct Framework document. - Ensure accuracy of data in test item databases. - Set functional team goals and expectations for Speaking test development. - Monitor progress and performance of staff completing Speaking test development tasks. - Mentor test development staff in job duties and professional development. - Fulfill administrative responsibilities related to hiring/retention and performance reviews. - Other duties as assigned. - Requires occasional travel (1-3 times per year). - Physical demands: regularly communicate; may be required to sit or stand in stationary position for 50% of time; constantly operates computer and other office productivity equipment; ADA compliant. We need to ensure we don't create overly long list but preserve all. It's okay. Qualifications: Education and Experience: Bachelor’s degree + 5 years relevant experience OR Master’s degree + 2 years relevant experience. Expertise in development of large-scale spoken English language proficiency assessments for K-12 multilingual learners. Ability to: experience supervising development of test items in high-stakes context; managing complex assessment projects; deep familiarity with spoken language K-12 multilingual learners must