Technical Program Manager, Inference

About the role

The AI/ML TPM team at CoreWeave owns delivery and execution across the AI/ML Platform Services organization. The team partners closely with Product, Engineering, Research, Infrastructure, and Go-to-Market teams to deliver scalable, reliable, and high-performance platforms that support the full AI lifecycle.

Responsibilities

• Lead cross-functional programs for customer onboarding across dedicated and serverless inference offerings, ensuring clear ownership, launch criteria, and readiness for strategic customer use cases.
• Drive launch readiness for new inference capabilities by aligning teams around real customer outcomes, supportability, and end-to-end validation.
• Coordinate multi-team execution across platform, infrastructure, and customer-facing teams to deliver reliable and scalable inference services.
• Build and operationalize success metrics, dashboards, launch gates, and review cadences to measure service reliability, onboarding readiness, efficiency, and quality across the inference stack.
• Create strong communication channels between Engineering, Product, Infrastructure, and Go-to-Market teams to align priorities and deliver predictable, high-impact outcomes.

Requirements

• Bachelor's degree in a technical field or equivalent practical experience.
• 8+ years of technical program management experience in distributed systems, cloud infrastructure, or AI/ML platform engineering.
• Proven experience driving large-scale infrastructure or platform programs from concept to production in complex, cross-functional environments.
• Strong technical fluency in distributed inference systems, GPU compute, cloud-native architectures, and performance optimization.
• Demonstrated success driving measurable improvements in reliability, performance, operational readiness, or customer delivery.
• Excellent written and verbal communication skills, with the ability to align engineering, product, infrastructure, and customer-facing stakeholders around shared goals.
• Experience with inference-serving systems, model onboarding workflows, rollout strategies, and observability tooling.
• Familiarity with launch readiness, supportability, incident follow-through, and release validation for production infrastructure or platform services.
• Experience operating in high-growth environments where roadmap execution, reliability expectations, and customer commitments must be managed in parallel.

Qualifications

• Curiosity about how large-scale inference systems evolve across runtime performance, operational excellence, and customer onboarding.
• Effectiveness at creating clarity and momentum across ambiguous, fast-moving multi-team initiatives.
• Enjoyment of turning technically complex platform work into predictable execution and successful launches.

Skills

• Technical fluency in distributed inference systems, GPU compute, cloud-native architectures, and performance optimization.
• Experience with inference-serving systems, model onboarding workflows, rollout strategies, and observability tooling.
• Experience with launch readiness, supportability, incident follow-through, and release validation for production infrastructure or platform services.
• Experience operating in high-growth environments where roadmap execution, reliability expectations, and customer commitments must be managed in parallel.

Benefits

• Medical, dental, and vision insurance - 100% paid by CoreWeave.
• Company-paid Life Insurance.
• Voluntary supplemental life insurance.
• Short and long-term disability insurance.
• Flexible Spending Account (FSA).
• Health Savings Account (HSA).
• Tuition Reimbursement.
• Ability to participate in Employee Stock Purchase Program (ESPP).
• Mental Wellness Benefits through Spring Health.
• Family-Forming support provided by Carrot.
• Paid Parental Leave.
• Flexible, full-service childcare support with Kinside.
• 401(k) with a generous employer match.
• Catered lunch each day in our office and data center locations.
• A casual work environment.
• A work culture focused on innovative disruption.

Pay

The base salary range for this role is $198,000 to $264,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation.

Schedule

CoreWeave offers a flexible schedule to support work-life balance.