Principal Developer, AI Networking
About the role
The AI Networking Codesign and Benchmarking R&D group requires a senior software engineer to characterize AI workloads and deep learning models aimed at large-scale LLM training and inference on NVIDIA supercomputers. The role focuses on distributed systems with a strong emphasis on high-performance networking and NVIDIA communication libraries.
Responsibilities
- Characterize AI workloads and deep learning models aimed at large-scale LLM training and inference on NVIDIA supercomputers.
- Benchmark, profile, and analyze the performance to find bottlenecks and identify areas for improvement and optimizations, with a strong emphasis on networking aspects.
- Develop PyTorch trace-based profiling, analysis, and replaying toolset to aid in benchmarking, debugging, and co-designing network systems for LLM workloads.
- Collaborate with multiple teams from hardware to software to provide performance analysis insights.
- Define performance test plans, set performance expectations for new technologies and solutions, and work to achieve performance targets.
Requirements
- B.Sc in Computer Science or Software Engineering or equivalent experience.
- 15+ years of experience with high-performance networking (RDMA, MPI, NCCL, SHARP).
- Demonstrated ability in performance evaluation techniques and approaches.
- Experience with NVIDIA GPUs and the CUDA library.
- Knowledge of deep learning frameworks like TensorFlow or PyTorch.
- Expertise in networking collective communication libraries such as NCCL and protocols like RoCE and RDMA.
- Fast and self-learning capabilities with strong analytical and problem-solving skills.
- Proficiency in programming languages: Python, Bash, and C++.
- Experience with a container-based development environment.
- Great teammate who communicates clearly and works well with others.
Qualifications
- Extensive understanding and hands-on experience with AI workloads and benchmarking for distributed LLM training.
- Knowledge in PyTorch, CUDA, and NCCL libraries.
- Comprehensive system knowledge and understanding (Intel / AMD / ARM CPUs, NVIDIA GPUs, HCA, Memory, PCI).
- Strong capabilities in performance evaluation and methods using contemporary tools.
Benefits
Competitive salaries and a generous benefits package are offered. NVIDIA is widely considered to be one of the technology world's most desirable employers. The company has some of the most forward-thinking and hardworking people in the world working for them, and due to unprecedented growth, their exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is $272,000 - $431,250 for Level 6, and $320,000 - $488,750 for Level 7. You will also be eligible for equity and benefits.
Pay
Not specified
Schedule
Not specified