Evaluation and ML Systems Engineer, AI Safety and Security Engineering

Evaluation/ML-Systems Engineer

NVIDIA is seeking an Evaluation/ML-Systems Engineer to join the AI Safety & Security Engineering team. This role involves building and evaluating AI-powered tooling that helps find, validate, and patch software vulnerabilities. The ideal candidate will design metrics, choose baselines, and write protocols that make comparisons fair. They will also build the infrastructure that keeps every result tied to the run that produced it.

What You'll Be Doing

• Evaluation infrastructure: Build the benchmarking and reproducibility systems we depend on.
• Metrics and protocols: Define the metrics and protocols we measure against.
• Traceability: Map every result to the code and runs that produced it.
• Evidence discipline: Keep findings reviewable and conclusions traceable.

What We Need To See

• Bachelor's degree (or equivalent experience) with 5+ years in ML engineering or evaluation.
• Evaluation experience: Designing benchmarks, metrics, and statistically sound comparisons for ML systems.
• Measurement rigor: A careful, skeptical approach to metrics, baselines, and claims.
• Engineering skills: Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.

Ways To Stand Out From The Crowd

• Security evaluation: Exposure to evaluating security tooling or pipelines.
• Agentic systems: Experience measuring agent or LLM behavior.
• Community work: Contributions to public benchmarks or evaluation frameworks.

Company Information

• Competitive salaries and a generous benefits package.
• Opportunities to grow in impactful fields: Confidential Computing and Data.
• AI tools used in recruiting processes.
• Committed to fostering an inclusive work environment.
• Equal opportunity employer.

Application Details

• Applications accepted until July 30, 2026.
• Existing vacancy.
• Base salary range: 152,000 USD - 241,500 USD.
• Eligible for equity and benefits.