DirectJobHub
Jobs · Engineering · California

Member of Technical Staff, Kernels

Magic · San Francisco, CA · 1 wk ago
On-siteEngineering$225k–$550k/yrFull-time

About the role

Magic's mission is to build safe AGI that accelerates humanity's progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

Responsibilities

  • Design and implement kernels that support high-performance long-context behavior
  • Ownership of kernel design, implementation, deployment, and production reliability
  • Focus on robustness, extensive testing, and functional correctness, while pushing on performance
  • Evaluate porting Magic’s compute kernels to alternative hardware options
  • Co-design kernels with understanding and interaction with training, inference, and RL teams

Requirements

Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs

Develop and optimize GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, Flash-Attention, and similar frameworks

Experience in other kernel authoring frameworks such as Pallas/Mosaic (GPU or TPU), or Mojo also maps well to the work on Magic's kernel team

Strong depth over shallow breadth: for kernel engineering, we prefer candidates with deep expertise in computer architecture, low-level machine optimizations, and code generation, with breadth across ML

Agility, ownership mindset, and grit

Qualifications

Compensation, Benefits And Perks (US)

  • Annual salary ranges between $225K - $550K based on experience
  • Equity is a significant part of total compensation, in addition to salary
  • 401(k) plan with 6% salary matching
  • Generous health, dental and vision insurance for you and your dependents
  • Unlimited paid time off
  • Visa sponsorship and relocation stipend to bring you to SF, if possible

Skills

A small, fast-paced, highly focused team

Benefits

Affordable and comprehensive benefits package including:

  • Health, dental, and vision insurance
  • 401(k) plan with 6% salary matching
  • Unlimited paid time off
  • Relocation stipend to bring you to San Francisco, if possible

Pay

Annual salary ranges between $225K - $550K based on experience

Schedule

N/A

Similar jobs