Software Engineer, AI Inference

Responsibilities

• Develop and optimize runtime AI inference pipelines for real-world robotic deployment.
• Build infrastructure, frameworks, and tooling to enable reliable integration of models into robotic systems and informative analysis of production models to drive the direction of architecture choice and deployment system design.
• Formulate specialized optimization solutions for various inference paradigms and scenarios (autoregressive models, denoising models, hierarchical models, state machines, multi-agent systems, cloud-based inference).
• Adapt optimization solutions to various compute, hardware, and networking constraints.

Preferred Qualifications

• BS, MS or higher degree in Computer Science, Robotics, Engineering or a related field, or equivalent practical experience.
• Minimum of 3 years of industry experience.
• Proficiency developing in low-level systems languages (C, C++, Rust, Go), Python and at least one deep learning library such as PyTorch, TensorFlow, JAX, etc.
• Deep understanding and practical experience with low-level systems concepts (multithreading, networking, embedded systems, memory management).
• Experience with CUDA.
• Deep understanding of state-of-the-art machine learning techniques and models.
• Experience optimizing various machine learning architectures.
• Experience with machine learning compilers.
• Experience optimizing model inference for robotic systems deployment.

Pay

Base Salary Range: $100,000 - $300,000 USD