Evaluation and ML Systems Engineer, AI Safety and Security Engineering

Evaluation/ML-Systems Engineer

NVIDIA is seeking an Evaluation/ML-Systems Engineer to join the AI Safety & Security Engineering team. This role involves building and evaluating AI-powered tooling that helps find, validate, and patch software vulnerabilities. The ideal candidate will design metrics, choose baselines, and write protocols that ensure comparisons are fair. They will also build infrastructure to tie every result to the code and runs that produced it.

What You'll Be Doing

• Evaluation infrastructure: Build the benchmarking and reproducibility systems we depend on.
• Metrics and protocols: Define the metrics and protocols we measure against.
• Traceability: Map every result to the code and runs that produced it.
• Evidence discipline: Keep findings reviewable and conclusions traceable.

What We Need To See

• Bachelor's degree (or equivalent experience) with 5+ years in ML engineering or evaluation.
• Evaluation experience: Designing benchmarks, metrics, and statistically sound comparisons for ML systems.
• Measurement rigor: A careful, skeptical approach to metrics, baselines, and claims.
• Engineering skills: Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.

Ways To Stand Out From The Crowd

• Security evaluation: Exposure to evaluating security tooling or pipelines.
• Agentic systems: Experience measuring agent or LLM behavior.
• Community work: Contributions to public benchmarks or evaluation frameworks.

Benefits

Competitive salaries and a generous benefits package are offered. NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer. Applications for this job will be accepted at least until July 30, 2026.