Member of Technical Staff, Inference & RL Systems
About the role
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.
Responsibilities
- Design and scale high-performance inference serving systems
- Optimize KV-cache management, batching strategies, and scheduling
- Improve throughput and latency for long-context workloads
- Build and maintain distributed RL and post-training infrastructure
- Improve reliability of rollout, evaluation, and reward pipelines
- Automate fault detection and recovery for serving and RL systems
- Profile and eliminate performance bottlenecks across GPU, networking, and storage layers
- Collaborate with Kernels and Research to align execution systems with model architecture
Requirements
Strong software engineering and distributed systems fundamentals
Experience building or operating large-scale inference or training systems
Deep understanding of GPU execution constraints and memory trade-offs
Experience debugging performance issues in production ML systems
Ability to reason about system-level trade-offs between latency, throughput, and cost
Track record of owning critical production infrastructure
Qualifications
Track record of owning critical production infrastructure
Skills
Strong software engineering and distributed systems fundamentals
Experience building or operating large-scale inference or training systems
Deep understanding of GPU execution constraints and memory trade-offs
Experience debugging performance issues in production ML systems
Ability to reason about system-level trade-offs between latency, throughput, and cost
Benefits
Annual salary range: $225K - $550K
Equity is a significant part of total compensation, in addition to salary
401(k) plan with 6% salary matching
Generous health, dental and vision insurance for you and your dependents
Unlimited paid time off
Visa sponsorship and relocation stipend to bring you to SF, if possible
A small, fast-paced, highly focused team
Pay
Annual salary range: $225K - $550K
Schedule
N/A