Jobs · Engineering · New York

Member of Technical Staff - Safety

Reflection · New York, NY · 1 wk ago
On-siteEngineeringFull-time

About the role

Own the red-teaming and adversarial evaluation pipeline for Reflection’s models, continuously probing for failure modes across security, misuse, and alignment gaps.
Work hand-in-hand with the Alignment team to translate safety findings into concrete guardrails, ensuring models behave reliably under stress and adhere to deployment policies.
Validate that every release meets the lab’s risk thresholds before it ships, serving as a critical gatekeeper for our open weight releases.
Develop scalable, automated safety benchmarks that evolve alongside our model capabilities, moving beyond static datasets to dynamic adversarial testing.
Research and implement state-of-the-art jailbreaking techniques and defenses to stay ahead of potential vulnerabilities in the wild.

Responsibilities

  • Own the red-teaming and adversarial evaluation pipeline for Reflection’s models
  • Translate safety findings into concrete guardrails
  • Validate releases meet risk thresholds
  • Develop safety benchmarks
  • Research and implement jailbreaking techniques and defenses

Requirements

  • Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience in AI Safety
  • Strong software engineering capabilities with experience building automated evaluation pipelines or large-scale ML systems
  • Experience with Reinforcement Learning (RLHF/RLAIF) and its impact on model safety and alignment
  • Fast-paced, high-agency startup environment with bias toward action
  • High-stakes decision-making regarding model release and safety thresholds
  • Passionate about advancing the frontier of intelligence

Qualifications

  • Deep technical understanding of LLM safety, including adversarial attacks, red-teaming methodologies, and interpretability

Skills

  • Strong problem-solving skills
  • Excellent communication and collaboration abilities

Benefits

We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.

What We Offer

  • Top-tier compensation: Salary and equity structured to recognize and retain our talent globally
  • Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options
  • Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance
  • Meals: Lunch and dinner are provided in the office daily
  • Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys
  • Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
  • Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable
  • Team building: We have regular off-sites, happy hours, and team celebrations

Similar jobs