HPC Performance Engineer

About the role

The HAVOCK Team at CoreWeave is seeking a highly skilled and motivated HPC Performance Engineer to join our dynamic and innovative environment. Reporting into the Manager of Systems Engineering, this role plays a crucial part in the design, development, and optimization of our bare-metal systems from POST through joining a Kubernetes cluster.

Responsibilities

• Develop and maintain tools for establishing systems performance baselines
• Develop and maintain performance regression analysis testing automation
• Design and maintain performance regression test pipelines for HPC workloads
• Debug and tune fabric-level performance to ensure low-latency high throughput configurations
• Development of telemetry for performance analysis across distributed clusters of servers
• Triage and fix performance issues in Linux
• Collect data, produce metrics and visualizations that communicate performance information compared to benchmarks; this data should lead to appropriate business decisions and toward greater automation that improves customer experience in relation to performance
• Define Linux and OS requirements, specifications, and system architecture in relation to systems performance, in collaboration with cross-functional teams

Requirements

• 5+ years of professional experience in Systems/HPC Performance Engineering, Benchmarking, and/or Validation
• Bachelor’s degree in Computer Engineering, Electrical Engineering, Computer Science, or a related field
• Strong experience with MPI workloads and distributed system performance analysis
• Familiarity with RoCE, InfiniBand, and GPUDirect/Data Direct I/O, NUMA, etc in HPC workloads
• Hands-on use of public HPC benchmarks (HPCC, HPL, OSU, MLPerf-HPC, STREAM, IO500)
• Extensive, deep experience in Linux internals
• Fluency with a programming language geared toward automation (Python preferred, but others possible)
• Experience writing robust, testable code
• Experience diagnosing and fixing systems performance issues
• Experience with implementing automation testing
• Strong passion for automation, with a commitment to automating processes comprehensively
• Excellent documentation skills and attention to detail
• Strong analytical and problem-solving abilities

Qualifications

• Preferred: Familiarity with QA/QE best practices
• Preferred: Familiarity with Golang
• Preferred: Experience working in Cloud environments
• Preferred: Experience as a software engineer writing large-scale applications
• Preferred: Experience in open-source community software development
• Preferred: Experience with machine learning

Skills

• Python
• Go
• bash/sh
• CPrometheus
• Victoria Metrics
• Grafana
• Linux Kernel (custom build)
• Ubuntu
• Intel/AMD/ARM CPUs
• Nvidia GPUs
• DPUs
• Infiniband and Ethernet NICs
• Docker
• kubernetes (k8s)
• KubeVirt
• containerd
• kubelet

Benefits

CoreWeave offers a comprehensive benefits program including medical, dental, and vision insurance, company-paid life insurance, short and long-term disability insurance, a flexible spending account, a health savings account, tuition reimbursement, a mental wellness benefit through Spring Health, family-forming support provided by Carrot, paid parental leave, flexible, full-service childcare support with Kinside, a 401(k) with a generous employer match, an employee stock purchase program (ESPP), catered lunch each day in our office and data center locations, a casual work environment, and a work culture focused on innovative disruption. Additionally, we provide a discretionary bonus and equity awards.

Pay

The base salary range for this role is $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location.

Schedule

CoreWeave offers a flexible schedule to accommodate the needs of our employees.