Applied AI Research Engineer

About the role

We’re looking to hire someone to own inference research hands-on and find ways to lower cost per token and latency on our customer workloads.

Responsibilities

• Low-level inference optimization, from speculative decoding, quantization, KV-cache and memory management
• Work directly with customers to optimize their production workloads, and apply your learnings to our platform as product improvements
• High-level of autonomy to find the highest upside bets and guide the future of our inference platform based on your work

Requirements

• Systems or research background in LLM inference
• Deep understanding of LLM serving, from the kernel to the scheduler
• History of shipping products or research that people use in production-like scenarios, whether academic or industry
• Excited to collaborate closely with customers
• Enthusiasm for developer tools, cloud native technologies, and open source software

Qualifications

• Competitive salary and meaningful equity
• Join a fast-growing pre-series A company at the ground floor
• Health, dental, and vision benefits with 90% coverage for you and 50% for dependents
• Opportunities to participate in events across the cloud native community
• Fitness stipend, learning budget, and much, much more