Sr. Engineering Manager, Inference

Responsibilities

• Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience.
• Drive execution on roadmap initiatives in close partnership with Product, ensuring that platform capabilities are delivered predictably, robustly, and with measurable customer impact.
• Own the engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality.
• Partner with CoreWeave’s infrastructure teams to integrate capabilities from the underlying inference platform into a cohesive, user-facing product.
• Guide the design and delivery of application-layer enhancements such as tracing and tool call handling.
• Ensure the inference offering meets high standards of reliability, usability, compliance, and performance, balancing trade-offs across cost, operational load, and architectural constraints.
• Create clarity in complex, cross-functional environments, ensuring strong communication, aligned priorities, and smooth execution across multiple teams.
• Build a culture of ownership, technical excellence, and continuous improvement within the engineering team.

Requirements

• 7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible for distributed systems, developer platforms, or large-scale services.
• Fluent in concepts related to distributed compute services, including observability, autoscaling patterns, reliability engineering, API design, and service operations.
• Comfortable with competing priorities and making principled trade-offs among latency, reliability, cost, and development velocity.
• Skilled at leading engineering teams through ambiguous, multi-stakeholder projects with strong communication and alignment.
• Deep empathy for ML practitioners and platform developers, with a drive to improve reliability, reduce friction, and elevate the developer experience.

Qualifications

• Preferred background in high-scale systems, real-time APIs, or cloud infrastructure, ideally with exposure to model-serving or inference-adjacent domains.
• Background in related platform domains such as IAM, billing/metering, observability systems, or deployment tooling.

Benefits

• The base salary range for this role is $188,000 to $303,000.
• In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).
• We offer a variety of benefits to support your needs, including medical, dental, and vision insurance, company-paid life insurance, voluntary supplemental life insurance, short and long-term disability insurance, flexible spending account, health savings account, tuition reimbursement, ability to participate in employee stock purchase program (ESPP), mental wellness benefits through Spring Health, family-forming support provided by Carrot, paid parental leave, flexible, full-service childcare support with Kinside, 401(k) with a generous employer match, flexible PTO, catered lunch each day in our office and data center locations, a casual work environment, and a work culture focused on innovative disruption.