Sr. Software Engineer - Perf and Benchmarking

About the role

We're looking for a Senior Engineer for CoreWeave’s Benchmarking & Performance team. You will play a crucial role in our planet-scale performance data warehouse, measuring and improving latency, throughput, and reliability across our global infrastructure.

Responsibilities

• Build and improve Kubernetes-native benchmarking services that measure latency, throughput, jitter, and cost-per-request across CoreWeave’s compute stack.
• Implement and maintain benchmarking workflows for end-to-end MLPerf Training and Inference runs, including workload setup, cluster configuration, runbooks, and result validation.
• Lead design reviews and drive architecture within the team; decompose multi-service work into clear milestones.
• Mentor junior engineers; review cross-team designs and elevate coding/testing standards.
• Help ensure reproducible, well-documented benchmarking processes.

Requirements

• 5+ years of experience building distributed systems, high-performance computing, or cloud services.
• Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance.
• Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry).
• Experience with performance-critical GPU systems (CUDA, NCCL, RDMA, NVLink/PCIe, memory bandwidth) and model-serving stacks (llm-d, vLLM, TensorRT-LLM, Megatron-LM).
• Strong communicator comfortable collaborating with cross-functional teams and external partners.

Qualifications

• Nice to have: Experience with time-series databases, LSM-based storage engines, or custom data pipelines.
• Experience running MLPerf submissions or similar large-scale audited benchmarks.
• Contributions to OSS projects such as llm-d, vLLM or PyTorch.
• Exposure to benchmarking large GPU fleets or multi-region clusters.
• Experience with CUDA kernels, NCCL/SHARP, RDMA/NUMA, or GPU interconnect topologies.

Skills

• Experience with Kubernetes at production scale.
• Knowledge of networked systems and performance.
• Ability to mentor junior engineers.
• Experience with CI/CD and observability stacks.
• Experience with performance-critical GPU systems.
• Experience with time-series databases, LSM-based storage engines, or custom data pipelines.
• Experience with MLPerf submissions or similar large-scale audited benchmarks.
• Contributions to OSS projects such as llm-d, vLLM or PyTorch.
• Exposure to benchmarking large GPU fleets or multi-region clusters.
• Experience with CUDA kernels, NCCL/SHARP, RDMA/NUMA, or GPU interconnect topologies.

Benefits

• The base salary range for this role is $139,000 to $204,000.
• Discretionary bonus.
• Equity awards.
• A comprehensive benefits program including medical, dental, and vision insurance, company-paid Life Insurance, Voluntary supplemental life insurance, Short and long-term disability insurance, Flexible Spending Account, Health Savings Account, Tuition Reimbursement, Ability to Participate in Employee Stock Purchase Program (ESPP), Mental Wellness Benefits through Spring Health, Family-Forming support provided by Carrot, Paid Parental Leave, Flexible, full-service childcare support with Kinside, 401(k) with a generous employer match, Flexible PTO, Catered lunch each day in our office and data center locations, A casual work environment, A work culture focused on innovative disruption, California Applicants California Consumer Privacy Act, Equal Opportunity & Accommodations, CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace, Export Control Compliance, This position requires access to export controlled information.