Senior Software Engineer, Agent Performance Modeling
About the role
Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing, an era in which our GPUs act as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent. As an NVIDIAN, you'll be immersed in a diverse, encouraging environment where everyone is inspired to do their best work. As LLM architectures and inference workloads evolve, understanding how they map to hardware is critical to designing efficient AI systems. Our team combines simulation and agentic engineering to understand emerging architectures and inform hardware and software decisions.
Responsibilities
- Building and validating performance models for LLM architectures across GPU, LPU, and heterogeneous systems.
- Developing agents to automate simulation workflows, analyze bottlenecks, and accelerate design space exploration.
- Collaborating with hardware architecture, inference, runtime, and compiler teams to improve modeling accuracy and guide optimization.
Requirements
- MS in Computer Science or a related field, with 5+ years of experience.
- Familiarity with modern LLM architectures and their inference characteristics.
- Experience with simulation, profiling, or performance modeling, including familiarity with roofline analysis for LLM inference.
- Strong analytical skills and a rigorous approach to experimentation and validation.
- Strong software engineering skills and experience building reliable engineering tools using coding agents like Claude Code, Codex, etc.
Skills
- Experience building agents that automate complex engineering workflows.
- Knowledge of accelerator architecture and compute, memory, or communication bottlenecks.
- Open-source contributions in agentic systems, simulation, or inference optimization.
Benefits
You will also be eligible for equity and benefits.
Pay
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.