Sr. Engineering Manager, Inference

Responsibilities

• Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience.
• Drive execution on roadmap initiatives in close partnership with Product, ensuring that platform capabilities are delivered predictably, robustly, and with measurable customer impact.
• Own the engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality.
• Partner with CoreWeave’s infrastructure teams to integrate capabilities from the underlying inference platform into a cohesive, user-facing product.
• Guide the design and delivery of application-layer enhancements such as tracing and tool call handling.
• Ensure the inference offering meets high standards of reliability, usability, compliance, and performance, balancing trade-offs across cost, operational load, and architectural constraints.
• Create clarity in complex, cross-functional environments, ensuring strong communication, aligned priorities, and smooth execution across multiple teams.
• Build a culture of ownership, technical excellence, and continuous improvement within the engineering team.

Requirements

• 7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible for distributed systems, developer platforms, or large-scale services.
• Fluent in concepts related to distributed compute services, including observability, autoscaling patterns, reliability engineering, API design, and service operations.
• Comfortable with competing priorities and making principled trade-offs among latency, reliability, cost, and development velocity.
• Skilled at leading engineering teams through ambiguous, multi-stakeholder projects with strong communication and alignment.
• Deep empathy for ML practitioners and platform developers, with a drive to improve reliability, reduce friction, and elevate the developer experience.

Qualifications

• Preferred background in high-scale systems, real-time APIs, or cloud infrastructure, ideally with exposure to model-serving or inference-adjacent domains.
• Background in related platform domains such as IAM, billing/metering, observability systems, or deployment tooling.

Benefits

• The base salary range for this role is $188,000 to $303,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location.
• In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).
• These benefits include: Medical, dental, and vision insurance - 100% paid for by CoreWeave; Company-paid Life Insurance; Voluntary supplemental life insurance; Short and long-term disability insurance; Flexible Spending Account; Health Savings Account; Tuition Reimbursement; Ability to Participate in Employee Stock Purchase Program (ESPP); Mental Wellness Benefits through Spring Health; Family-Forming support provided by Carrot; Paid Parental Leave; Flexible, full-service childcare support with Kinside; 401(k) with a generous employer match; Flexible PTO; Catered lunch each day in our office and data center locations; A casual work environment; A work culture focused on innovative disruption.