Senior AI Training Performance Architect

About the role

NVIDIA is seeking a senior engineer who is obsessed with performance analysis and optimization to help squeeze every last clock cycle out of AI training. This role offers the opportunity to directly impact the hardware and software roadmap in a fast-growing technology company leading the AI revolution.

Responsibilities

• Understand, analyze, profile, and optimize AI training workloads on state-of-the-art hardware and software platforms.
• Identify performance bottlenecks of AI training on GPUs, prioritize, and solve problems across key AI training workloads.
• Implement production-quality software across multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
• Build and support NVIDIA submissions for MLPerf Training benchmarks.
• Implement key DL training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies.
• Develop tools to automate workload analysis, optimization, and other critical workflows.

Requirements

• PhD in CS, EE or CSEE (or equivalent experience) with 5+ years of relevant experience; or MS with 8+ years of experience.
• Strong background in deep learning and neural networks, particularly in training.
• Solid understanding of computer architecture and familiarity with GPU architecture fundamentals.
• Proven background in analyzing and tuning application performance.
• Proven experience with processor and system-level performance modeling.
• Proficiency in programming with C++, Python, and CUDA.

Qualifications

• Experience with AI training and optimization techniques.
• Knowledge of GPU architectures and their impact on AI training performance.
• Experience with MLPerf Training benchmarks and related testing.
• Experience with deep learning frameworks and simulators.

Skills

• Deep understanding of AI training and optimization techniques.
• Experience with GPU architectures and their impact on AI training performance.
• Experience with MLPerf Training benchmarks and related testing.
• Experience with deep learning frameworks and simulators.

Benefits

The position offers a competitive salary range based on experience and location, as well as eligibility for equity and benefits.

Pay

Base salary range: $184,000 - $287,500 for Level 4, and $224,000 - $356,500 for Level 5.

Schedule

Full-time position.