Senior AI Training Performance Architect

About the role

NVIDIA is seeking a senior engineer to optimize AI training workloads on state-of-the-art hardware and software platforms. This role involves working across all layers of the hardware/software stack to achieve peak performance.

Responsibilities

• Understand, analyze, profile, and optimize AI training workloads on state-of-the-art hardware and software platforms.
• Identify performance bottlenecks of AI training on GPUs, prioritize and solve problems across key AI training workloads.
• Implement production-quality software across multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
• Build and support NVIDIA submissions for MLPerf Training benchmarks.
• Implement key DL training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies.
• Develop tools to automate workload analysis, optimization, and other critical workflows.

Requirements

• PhD in CS, EE or CSEE (or equivalent experience) with 5+ years of relevant experience; or MS with 8+ years of experience.
• Strong background in deep learning and neural networks, particularly in training.
• Solid understanding of computer architecture and familiarity with GPU architecture fundamentals.
• Proven background in analyzing and tuning application performance.
• Proven experience with processor and system-level performance modeling.
• Proficiency in programming with C++, Python, and CUDA.

Qualifications

• Experience with NVIDIA's deep learning platform and tools.
• Knowledge of MLPerf Training benchmarks.
• Experience with GPU architecture and performance optimization.

Skills

• Deep learning and neural networks expertise.
• Strong analytical and problem-solving skills.
• Experience with GPU architecture and performance optimization.
• Programming proficiency in C++, Python, and CUDA.

Benefits

• Competitive base salary ranging from $184,000 - $287,500 for Level 4, and $224,000 - $356,500 for Level 5.
• Equity and benefits package.

Pay

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

Schedule

Details on the schedule will be provided upon employment.

Benefits

• Comprehensive health insurance options.
• Flexible spending accounts.
• Retirement savings plans.
• Employee assistance programs.
• Professional development opportunities.

Application Instructions

Applications for this job will be accepted at least until July 28, 2026.