HPC Performance Engineer
About the role
CoreWeave is seeking a highly skilled and motivated HPC Performance Engineer to join our HAVOCK Team, reporting into the Manager of Systems Engineering.
Responsibilities
- Develop and maintain tools for establishing systems performance baselines
- Develop and maintain performance regression analysis testing automation
- Design and maintain performance regression test pipelines for HPC workloads
- Debug and Tune fabric-level performance to ensure low-latency high throughput configurations
- Development of telemetry for performance analysis across distributed clusters of servers
- Triage and fix performance issues in Linux
- Collect data, produce metrics and visualizations that communicate performance information compared to benchmarks; this data should lead to appropriate business decisions and toward greater automation that improves customer experience in relation to performance
- Define Linux and OS requirements, specifications, and system architecture in relation to systems performance, in collaboration with cross-functional teams
Requirements
- 5+ years of professional experience in Systems/HPC Performance Engineering, Benchmarking, and/or Validation
- Bachelor’s degree in Computer Engineering, Electrical Engineering, Computer Science, or a related field
- Strong experience with MPI workloads and distributed system performance analysis
- Familiarity with RoCE, InfiniBand, and GPUDirect/Data Direct I/O, NUMA, etc in HPC workloads
- Hands-on use of public HPC benchmarks (HPCC, HPL, OSU, MLPerf-HPC, STREAM, IO500)
- Extensive, deep experience in Linux internals
- Fluency with a programming language geared toward automation (Python preferred, but others possible)
- Experience writing robust, testable code
- Experience diagnosing and fixing systems performance issues
- Experience with implementing automation testing
- Able to effectively prioritize and communicate proposed features and fixes in a remote-employee environment
- Strong passion for automation, with a commitment to automating processes comprehensively
- Excellent documentation skills and attention to detail
- Strong analytical and problem-solving abilities
Qualifications
- Preferred: Familiarity with QA/QE best practices
- Preferred: Familiarity with Golang
- Preferred: Experience working in Cloud environments
- Preferred: Experience as a software engineer writing large-scale applications
- Preferred: Experience in open-source community software development
- Preferred: Experience with machine learning
Skills
- Python
- Go
- bash/sh
- CPrometheus
- Victoria Metrics
- Grafana
- Linux Kernel (custom build)
- Ubuntu
- Intel/AMD/ARM CPUs
- Nvidia GPUs
- DPUs
- Infiniband and Ethernet NICs
- Docker
- kubernetes (k8s)
- KubeVirt
- containerd
- kubelet
Benefits
The base salary range for this role is $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).
Pay
The base salary range for this role is $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).
Schedule
Not specified.