Member of Technical Staff, ML Systems

About The Role

We’re looking for a motivated LLM Systems Engineer willing to explore new and unconventional inference systems based on emerging hardware. This role is part engineering, part research – you’ll be responsible for searching and prototyping various algorithms suitable for our inference hardware, as well as guiding our hardware team on the product definition.

Essential Duties And Responsibilities

• Prototype and optimize emerging ML inference systems.
• Develop novel memory models for expandable vRAM.
• Write efficient GPU kernels for data movement.
• Perform design-space exploration, implementation, and benchmarking of inference engines, both in simulations and on real hardware.

Qualifications

• MS or PhD in computer systems, ideally with a focus on LLM inference and/or distributed systems.
• Prior experience contributing to the core LLM inference infrastructures (vLLM, SGLang, TensorRT, etc.).
• Prior experience in accelerator programming (e.g. CUDA, JAX/Pallas, ROCm).
• Advanced computer architectures and performance engineering skills is a big plus.

Culture

You’ll work alongside a group of people who care deeply about rigor, clarity, and impact. We value thoughtful disagreement, fast learning, and intellectual fearlessness. This is a place where strong ideas shine, curiosity is encouraged, and growth is a daily practice.

Compensation & Benefits

Competitive salary commensurate with experience including base salary, incentive-based bonus, and early stage equity grant. Comprehensive benefits including health, dental, vision, and life insurance. Well-equipped, sunny offices in Santa Clara, CA and Boston, MA. Relocation assistance and visa sponsorship.

Perks

• A daily lunch stipend.
• 401k match.
• More.