System Software Engineer - AI

About the role

We are looking for a talented System Software Engineer to help us redefine the infrastructure layer of AI. In this role, you will bridge the gap between high-level AI frameworks and low-level system software. You will be responsible for designing and implementing the communication and execution primitives that allow large-scale AI models to run efficiently across thousands of GPUs.

Responsibilities

• Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next-generation AI models.
• Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface.
• Conduct rigorous performance benchmarking and characterization on multi-node clusters.

Requirements

• Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).
• Proficient in a Linux development environment.
• Experience with GPU programming (CUDA) and performance optimization for parallel architectures.
• Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).
• Hands-on experience with large-scale cluster orchestration and telemetry tools.

Qualifications

• Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field.

Skills

• Desired skills include but are not limited to:

• Experience with GPU programming (CUDA) and performance optimization for parallel architectures.
• Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).
• Hands-on experience with large-scale cluster orchestration and telemetry tools.

Benefits

Compensation Target base salary for this role is $140,000 - $200,000 per year + meaningful equity + benefits + 401k. Our salary ranges are determined by role, level, experience, and location.