Runtime Engineer

About the role

We're looking for a Runtime Engineer to design and build the multi-target runtime that sits at the heart of our AI compiler stack. This is a systems-level role where you'll take the output of our optimizing compiler and make it execute — efficiently, correctly, and at scale — across a diverse landscape of hardware targets.

You'll work on low-level parallelization, kernel scheduling, and performance analysis, and collaborate closely with our compiler and product teams to push the boundaries of what's possible on modern AI hardware.

What you'll do

• Design, develop, maintain, and improve our multi-target runtime.
• Apply the latest techniques in parallelization and partitioning to automate kernel generation and exploit highly optimized execution paths.
• Rapidly prototype and data-drive exploration of new runtime ideas.
• Benchmark and analyze the outputs produced by our optimizing compiler on target hardware.
• Build tools to collect and analyze performance bottlenecks.
• Work closely with our product team to understand the evolving needs of ML engineers and drive improvements in runtime architecture.

Requirements

• Essential Skills and Experience:
  • BS degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • 4+ years of experience working with compilers or runtime systems.
  • Deep understanding of asynchronous and concurrent programming.
  • 4+ years of experience with C/C++ (C++14 or newer).
  • Understanding of hardware architecture: vector vs. scalar registers and instructions, memory hierarchies.
  • Knowledge of operating system kernel development or hypervisor development.
• Preferred Skills and Experience:
  • Master's or PhD in Computer Science, Computer Engineering, or equivalent.
  • Experience developing or maintaining GPU compute libraries such as CUDA or ROCm.
  • Experience with GPU programming and optimization.
  • Background in high-performance computing (HPC).
  • Knowledge of deep learning frameworks such as PyTorch, JAX, or Triton.
  • Experience programming large compute clusters.

Benefits

Competitive compensation including equity, medical/dental/vision, retirement savings, and wellness benefits.

Lemurian Labs is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of gender identity, race, ethnicity, sexual orientation, disability status, age, or background.