Senior Software Engineer, Cluster Orchestration
About the role
As part of the Cluster Orchestration team, you will play a key role in advancing CoreWeave’s orchestration platform including SUNK (Slurm on Kubernetes) and beyond our Kubernetes-native foundation that powers AI training and inference at scale. This is an opportunity to help shape one of the most critical layers of the AI cloud: ensuring workloads run seamlessly, reliably, and efficiently across massive GPU clusters. By building the systems that eliminate infrastructure bottlenecks and create new orchestration capabilities, you will directly empower customers to innovate faster and push the boundaries of what’s possible with AI.
Responsibilities
- Own multiple services within the orchestration platform
- Lead design/code reviews
- Decompose projects into milestones
- Drive measurable improvements in reliability and performance
- Define SLIs/SLOs for your services
- Strengthen operational practices
- Mentor IC1/IC2 engineers
- Ensure customers see consistent improvements in throughput, latency, and system resilience
Requirements
- ~3–5 years of professional software engineering experience building distributed systems or cloud services
- Strong coding in Go (Python or C++ a plus) with solid CS fundamentals
- Hands-on experience running Kubernetes at production scale
- Familiarity with observability stacks (Prometheus, Grafana, OpenTelemetry)
- Proven ability to improve service reliability and performance using metrics (P95/P99 latency, throughput, error budgets)
- Preferred: Familiarity with orchestration and workflow technologies such as Ray, Kubeflow, Kueue, Istio, Knative, or Argo Workflows
- Experience with distributed workloads, GPU-based applications, or ML pipelines
- Knowledge of scheduling concepts like quota enforcement, pre-emption, and scaling strategies
- Exposure to reliability practices including SLOs, alarms, and post-incident reviews
Qualifications
- BS/MS in Computer Science or related field
- Experience with Kubernetes and container orchestration
- Understanding of cloud infrastructure and services
- Experience with monitoring and logging tools
- Experience with distributed systems and microservices architecture
Skills
- Proficiency in Go
- Experience with Python or C++
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
- Ability to work independently and in a team environment
Benefits
- The base salary range for this role is $139,000 to $204,000.
- We offer a comprehensive benefits program including medical, dental, and vision insurance, company-paid life insurance, short and long-term disability insurance, a flexible spending account, a health savings account, tuition reimbursement, a mental wellness benefit, a family-forming support program, an employee stock purchase plan, paid parental leave, flexible childcare support, a 401(k) with a generous employer match, flexible PTO, catered lunch, a casual work environment, and a focus on innovative disruption.
Pay
The base salary range for this role is $139,000 to $204,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location.
Schedule
Our schedule is flexible to accommodate the needs of our employees and the demands of the business.