ML Systems Performance Engineer
About the role
Engineers on the inference performance team operate at the intersection of hardware and software, driving end-to-end model inference speed and throughput. Their work spans low-level kernel performance debugging and optimization, system-level performance analysis, performance modeling and estimation, and the development of tooling for performance projection and diagnostics.
Responsibilities
- Build performance models (kernel-level, end-to-end) to estimate the performance of state of the art and customer ML models.
- Optimize and debug our kernel micro code and compiler algorithms to elevate ML model inference speed, throughput and compute utilization on the Cerebras WSE.
- Debug and understand runtime performance on the system and cluster.
- Develop tools and infrastructure to help visualize performance data collected from the Wafer Scale Engine and our compute cluster.
Requirements
- Bachelors / Masters / PhD in Electrical Engineering or Computer Science.
- Strong background in computer architecture.
- Exposure to and understanding of low-level deep learning / LLM math.
- Strong analytical and problem-solving mindset.
- 3+ years of experience in a relevant domain (Computer Architecture, CPU/GPU Performance, Kernel Optimization, HPC).
- Experience working on CPU/GPU simulators.
- Experience with performance profiling and debug on any system pipeline.
- Comfort with C++ and Python.
Why Join Cerebras
About People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
- Build a breakthrough AI platform beyond the constraints of the GPU.
- Publish and open source their cutting-edge AI research.
- Work on one of the fastest AI supercomputers in the world.
- Enjoy job stability with startup vitality.
- Their simple, non-corporate work culture that respects individual beliefs.
Pay
Competitive salary based on experience and qualifications.
Schedule
Full-time, remote position.
Benefits
We offer comprehensive benefits including health insurance, retirement plans, and paid time off.
Contact
To apply, please visit our careers page and submit your resume and cover letter.