Member of Technical Staff, GPU Compiler

About the role

We build the fastest GPU compiler in the world. Most compilers have to preserve correctness at every transform, constraining how far they can search, while we prove correctness at the end instead, allowing us to search a far wider space, with agents, with RL, with anything that works and still guarantee the result. It's why we hold #1 on NVIDIA's own kernel benchmark across hundreds of production kernels.

What you’ll do

• Build and extend MLIR dialects and passes to optimize training and inference workloads
• Work in our LLVM backend, below ptxas, on instruction selection, scheduling, register allocation and direct cubin emission and stand up equivalent depth on AMD, TPU and Trainium targets
• Expand our search-based compiler infrastructure, including agent- and RL-driven program search and the formal correctness proofs that make aggressive search safe
• Implement classic compiler optimizations tuned for large-scale training
• Create hybrid codegen paths for cases where direct MLIR lowering isn’t practical
• Own testing, benchmarking and performance regression systems, including bit-identical hardware models
• Work closely with our research team and with customer workloads to find the optimization opportunities that matter

What we’re looking for

• Deep experience in compiler infrastructure (LLVM, MLIR or similar)
• Strong background in GPU architecture and low-level optimization (CUDA, ROCm or similar)
• Hands-on experience with at least one of: PTX/SASS, GCN/RDNA assembly or other GPU ISAs
• Familiarity with ML compiler stacks (XLA, TVM, Triton, torch.compiler or similar)
• Solid systems programming skills in C++ and/or Rust
• Proven track record of building production-grade compiler infrastructure

Nice to have

• Experience in autotuning or search-based optimization
• Background in formal verification, proof assistants or SMT solvers
• Experience writing or maintaining an LLVM backend
• Background in distributed systems or multi-device compilation
• Contributions to open-source compiler projects
• Familiarity with large-scale training infrastructure
• Experience with (Stable)HLO

Why join us

Most compiler engineers spend their career inside a constraint they didn’t choose, forced to ensure that every transform is correct on its own. If you’ve ever wanted to put real search inside a compiler and never had the architectural freedom or the hardware budget to try it, this is the job for you.

This is a chance to work at the very bottom of the stack on a compiler that is already the fastest in the world, with a direct and measurable effect on the cost of every large training run we touch.

We’re a small team operating at frontier scale. We pre-trained foundation models on 4,000 AMD GPUs as a team of three, designed and brought up GB300 NVL72 clusters and designed a TOP500 supercomputer. We believe that hard problems get solved in person and most of our work happens at our office in San Francisco.

Pay

The base salary range for this full-time position is $285,000–$315,000, plus meaningful equity and benefits.