Evaluation and ML Systems Engineer, AI Safety and Security Engineering

NVIDIA is widely recognized as one of the most sought-after employers, with dedicated people working on foundational AI technologies. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling to find, validate, and patch software vulnerabilities. We prioritize evidence-based conclusions and seek an Evaluation/ML-Systems Engineer to own how we measure the program.

Responsibilities

• Build benchmarking and reproducibility systems for evaluation infrastructure.
• Define metrics and protocols to measure progress and ensure fair comparisons.
• Map every result to the code and runs that produced it for traceability.
• Keep findings reviewable and conclusions traceable to maintain evidence discipline.
• Automate measurement processes to allow focus on critical questions.
• Partner with security researchers and platform engineers to design trustworthy, rerunnable experiments.
• Foster a team culture of rigorously checking claims before relying on them.

Requirements

• Bachelor's degree (or equivalent experience) with 5+ years in ML engineering or evaluation.
• Experience designing benchmarks, metrics, and statistically sound comparisons for ML systems.
• A careful, skeptical approach to metrics, baselines, and claims.
• Solid Python engineering skills for shared infrastructure, including experiment tracking and data pipelines.

Skills

• Security evaluation: Exposure to evaluating security tooling or pipelines.
• Agentic systems: Experience measuring agent or LLM behavior.
• Community work: Contributions to public benchmarks or evaluation frameworks.

Benefits

NVIDIA offers a competitive salary and a generous benefits package, with a work environment that values creativity, autonomy, and technological innovation.

Pay

Base salary range: 152,000 USD - 241,500 USD. You will also be eligible for equity and benefits.