Staff Compiler Engineer

Position Overview

We are seeking a talented ML Compiler Engineer to join our engineering team and lead the development of our compiler. This role focuses on compiler development for our novel LLM accelerator architecture.

Key Responsibilities

• Design and implement toolchains for our custom LLM accelerator architecture
• Develop optimization strategies that bridge software algorithms to hardware implementations
• Design and implement custom compiler components, including IR dialects, graph transformations, and lowering passes
• Optimize computational graphs and memory access patterns for our hardware architecture
• Integrate with existing ML frameworks (e.g., PyTorch, JAX, Triton)
• Build and maintain test infrastructure to ensure compiler correctness and performance

Qualifications

• Master's degree in Computer Science or related field
• 5+ years of experience in compiler development
• Expert-level proficiency in Python and C
• Experience with hardware compilers
• Familiarity with Large Language Model architectures and their computational requirements
• Hands-on experience with compiler frameworks and code optimization techniques
• Deep understanding of computer architecture, memory hierarchies, and parallel computing concepts
• Experience with AI/ML accelerators (GPUs, TPUs, FPGAs) and their programming models

Preferred Skills

• PhD in Computer Science or related field
• 10+ years of industry experience
• Strong background in graph theory and graph transformations in a compiler or optimization context; MLIR experience is a plus
• Experience writing programs that parse, analyze, and mutate programs as abstract syntax trees
• Experience in instrumenting and debugging parallel programs
• Experience with structured, human-supervised AI/agentic coding workflows
• Experience with LLM quantization techniques and model optimization
• Familiarity with deep learning frameworks and neural network optimization

Technical Skills

• Programming Languages: Python and C (essential), Assembly
• Compiler Frameworks: LLVM, MLIR, GCC, custom backend development
• Graph Theory: Graph algorithms, graph rewriting systems, DAG optimization
• AST Processing: Parsing, analysis, and transformation of abstract syntax trees
• Testing & QA: pytest, GoogleTest, or similar frameworks; static analysis tools
• CI/CD: Jenkins, GitHub Actions, GitLab CI, or similar systems
• LLM Technologies: Transformer architectures, attention mechanisms, quantization techniques
• Development Tools: CMake, Git, Docker
• Parallel Tools: Profilers, debuggers, and instrumentation for parallel/concurrent programs

Benefits

• 100% coverage of base health plan premiums for you and your dependents, plus HSA contributions
• Unlimited PTO. No rigid vacation banks, just a focus on delivery
• 401(k) matching and stock option opportunities to ensure our success is your success
• Full suite of voluntary benefits, including Dental, Vision, Life, Hospital, Critical Illness, and Accident insurance
• Personalized Benefits. Choose the plans that fit your life and take the cash back for those that don’t