Research Engineer / Research Scientist, Tokens

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

Responsibilities

• Touch all parts of our code and infrastructure, whether that's making the cluster more reliable for our big jobs, improving throughput and efficiency, running and designing scientific experiments, or improving our dev tooling.
• Write code when understanding the research context and more broadly why it's important.
• Optimize the throughput of a new attention mechanism.
• Compare the compute efficiency of two Transformer variants.
• Making a Wikipedia dataset in a format models can easily consume.
• Scales a distributed training job to thousands of GPUs.
• Create a design doc for fault tolerance strategies.
• Create an interactive visualization of attention between tokens in a language model.

Requirements

• Significant software engineering experience.
• Results-oriented, with a bias towards flexibility and impact.
• Pick up slack, even if it goes outside your job description.
• Enjoy pair programming (we love to pair!)
• Want to learn more about machine learning research.
• Care about the societal impacts of your work.

Qualifications

• Strong Candidates May Also Have Experience With High performance, large-scale ML systems.
• GPUs, Kubernetes, Pytorch, or OS internals.
• Language modeling with transformers.
• Reinforcement learning.
• Large-scale ETL.

Skills

• Significant software engineering experience.
• High performance, large-scale ML systems.
• GPUs, Kubernetes, Pytorch, or OS internals.
• Language modeling with transformers.
• Reinforcement learning.
• Large-scale ETL.

Benefits

The annual compensation range for this role is listed below. For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role. Annual Salary $350,000—$500,000 USD.

Pay

Annual Salary $350,000—$500,000 USD

Schedule

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Guidance on Candidates' AI Usage

We have a policy for using AI in our application process. Learn about it here.