Jobs · Engineering · California

Member of Technical Staff - Safety

Reflection · San Francisco, CA · 1 wk ago
On-siteEngineeringFull-time

About the role

Own the red-teaming and adversarial evaluation pipeline for Reflection’s models, continuously probing for failure modes across security, misuse, and alignment gaps.
Work hand-in-hand with the Alignment team to translate safety findings into concrete guardrails, ensuring models behave reliably under stress and adhere to deployment policies.
Validate that every release meets the lab’s risk thresholds before it ships, serving as a critical gatekeeper for our open weight releases.
Develop scalable, automated safety benchmarks that evolve alongside our model capabilities, moving beyond static datasets to dynamic adversarial testing.
Research and implement state-of-the-art jailbreaking techniques and defenses to stay ahead of potential vulnerabilities in the wild.

Responsibilities

  • Own the red-teaming and adversarial evaluation pipeline for Reflection’s models, continuously probing for failure modes across security, misuse, and alignment gaps.
  • Work hand-in-hand with the Alignment team to translate safety findings into concrete guardrails, ensuring models behave reliably under stress and adhere to deployment policies.
  • Validate that every release meets the lab’s risk thresholds before it ships, serving as a critical gatekeeper for our open weight releases.
  • Develop scalable, automated safety benchmarks that evolve alongside our model capabilities, moving beyond static datasets to dynamic adversarial testing.
  • Research and implement state-of-the-art jailbreaking techniques and defenses to stay ahead of potential vulnerabilities in the wild.

Requirements

  • Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience in AI Safety.
  • Strong software engineering capabilities with experience building automated evaluation pipelines or large-scale ML systems.
  • Experience with Reinforcement Learning (RLHF/RLAIF) and how it impacts model safety and alignment is a strong plus.

Qualifications

  • Deep technical understanding of LLM safety, including adversarial attacks, red-teaming methodologies, and interpretability.
  • Thriving in a fast-paced, high-agency startup environment with bias toward action.
  • Willing to make high-stakes decisions regarding model release and safety thresholds.
  • Passionate about advancing the frontier of intelligence.

Skills

  • Technical skills in AI safety, adversarial attacks, and red-teaming methodologies.
  • Experience with software engineering and large-scale ML systems.
  • Knowledge of Reinforcement Learning (RLHF/RLAIF).

Benefits

  • Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
  • Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
  • Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
  • Meals: Lunch and dinner are provided in the office daily.
  • Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
  • Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
  • Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
  • Team building: We have regular off-sites, happy hours, and team celebrations.

Pay

Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.

Schedule

Unlimited paid time off in the U.S. and 30 days in the U.K.

Similar jobs