Risk Assessment Analyst (Youth AI Safety Institute)

Job Summary

The Youth AI Safety Institute at Common Sense Media is seeking a Risk Assessment Analyst to evaluate AI tools and platforms used by children, teens, and educators. This role involves designing and executing comprehensive assessments, analyzing data, and communicating findings to diverse stakeholders.

About the Role

The Risk Assessment Analyst will collaborate with the Head of AI & Digital Assessments to design and implement risk assessment test plans, conduct prompt testing, and analyze AI tool behaviors and safety mechanisms. They will also contribute to process improvements and stay updated on emerging research in AI safety and youth development.

Responsibilities

• Design and execute risk assessment test plans for AI tools and platforms used by kids, teens, and K–12 institutions.
• Conduct comprehensive evaluations of major AI platforms and emerging educational AI tools, following established methodologies.
• Implement systematic prompt testing procedures and apply standardized evaluation frameworks as directed.
• Run batch and manual prompt testing plans to produce AI system outputs across various scenarios, assessing behaviors, safety mechanisms, and content appropriateness.
• Analyze large data sets from testing procedures to identify patterns, risks, and safety considerations.
• Handle sensitive content evaluation, including potentially triggering or challenging material related to youth safety concerns.
• Conduct comprehensive background research on AI tools and platforms under assessment, synthesizing findings from academic papers, industry reports, and technical specifications.
• Prepare research briefs summarizing key background information, known risks, and relevant technical details to support assessment planning and execution.
• Compile and organize assessment data into structured formats for analysis and reporting.
• Document testing procedures and findings.
• Translate complex technical findings into clear, accessible reports for diverse audiences, including educators, parents and caregivers, policymakers, and industry stakeholders.
• Draft assessment reports using Common Sense Media's voice, tone, and editorial standards.
• Prepare executive summaries and key findings briefs for different stakeholder groups and communication channels, including clear data visualizations and summary materials.
• Collaborate with the Head of AI & Digital Assessments to develop public-facing risk assessment reports that meet Common Sense Media's standards for accuracy and accessibility.
• Manage assessment project timelines and deliverables in coordination with organizational priorities.
• Supervise Risk Assessment Fellows/Associates in executing research, assessment, and writing tasks.
• Cook up with subject matter experts and contractors for specialized testing or expertise as directed.

Requirements

• Bachelor's degree in relevant field (computer science, psychology, education, public policy, or related).
• 3–5 years of experience in research, data analysis, content moderation, or safety evaluations.
• Demonstrated experience with technical tools to support automated testing.
• Strong analytical skills, with experience in systematic evaluation methodologies.
• Excellent written communication skills, with the ability to document complex technical findings clearly.
• Ability to handle sensitive, potentially upsetting content related to youth safety in a professional context.

Qualifications

• Education: Bachelor's degree in relevant field (computer science, psychology, education, public policy, or related).
• Experience: 3–5 years in research, data analysis, content moderation, or safety evaluations.
• Technical proficiency: Demonstrated experience with technical tools to support automated testing.
• Research skills: Strong analytical skills, with experience in systematic evaluation methodologies.
• Communication: Excellent written communication skill, with the ability to document complex technical findings clearly.
• Content safety experience: Ability to handle sensitive, potentially upsetting content related to youth safety in a professional context.

Preferred Qualifications

• Previous experience in AI safety research, platform trust and safety, or technology risk assessment.
• Background in child development, educational psychology, or youth-focused research.
• Experience with data analysis and methods.
• Familiarity with AI platform APIs and testing frameworks.
• Knowledge of privacy regulations and educational technology compliance requirements.
• Experience working in collaborative, mission-driven organizations.

What We Offer

• The chance to work with talented, passionate professionals.
• A great health and welfare benefits package, including medical, dental, vision, a matching 401(k), and other key benefits.
• An organization that offers work/life balance.
• The opportunity to really make a difference in the lives of kids and families!