Engineering Manager - Forward Deployed Engineering (LLM)

Responsibilities

• Lead, mentor, and grow a team of Forward Deployed Engineers, providing guidance on technical direction, project execution, and professional development.
• Set clear goals and ensure timely, high-quality delivery across multiple customer-facing projects involving LLM deployment and inference optimization.
• Collaborate with leadership to align team priorities with company and customer goals, balancing short-term delivery, widely varying customer priorities, and long-term technical initiatives.
• Partner with product, infrastructure, and other customer engineering teams to ensure that large language models (LLMs) and other generative AI systems deliver best-in-class performance, reliability, and cost efficiency in production environments.

Requirements

• Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or related field.
• 4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship capacity.
• Strong programming skills in Python, with production experience in building or optimizing ML inference systems.
• Proven experience with LLMs, inference optimization, or serving frameworks (e.g., vLLM, TensorRT, Triton, Hugging Face, Ray Serve).
• Familiarity with observability, profiling, and cost/performance tradeoffs in production ML systems.
• Excellent communication and collaboration skills—able to lead cross-functional efforts and drive outcomes in ambiguous, fast-paced environments.

Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave.
• Fertility and family-building stipend through Carrot.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.