Software Engineer, Metrics, AI Evaluation

p class="metadata">Degree in Computer Science, Physics, Robotics Engineering, or equivalent experience. Competitive full-time benefits begin on day 1 of hire.

About the role

The AI Evaluation team ensures product safety by designing metrics for open and closed-loop simulation testing on telemetry from the fleet. Your work will influence L4 Unsupervised robotaxi operation, FSD v14+ customer satisfaction, and Optimus success. A strong candidate has a background in computer science, ML, or robotics engineering, with strong attention to detail and a self-driven attitude.

Responsibilities

• Design metrics to evaluate model predictions and vehicle motion across every scenario a self-driving robotaxi could encounter
• Work with AI researchers to evaluate & compare end-to-end FSD models
• Own projects from inception to completion and present them to org leadership
• Build tooling and automation to validate open-loop and closed-loop simulations
• Measure correlation between real-world driving and simulated rollouts, and drive down gaps end-to-end
• Mine data from the vast Customer fleet to surface high-value cases and turn them into reusable, high-signal evaluation scenarios
• De-noise eval results to surface high-value signal that guides model iterations and signoff decisions

Requirements

• Degree in Computer Science, Physics, or Robotics Engineering, or equivalent experience and evidence of exceptional ability
• Strong Python coding abilities
• Exposure to NumPy and Pandas for data manipulation
• Experience with SIL, HIL, open-loop, and closed-loop robotics eval (a plus)
• Experience with computer vision systems, ADAS features, path-planning, real-time embedded systems, sensor calibration, C++, and/or CAN (a plus)

Benefits

• Medical plans with $0 payroll deduction options
• Family-building, fertility, adoption, and surrogacy benefits
• Dental and vision plans with $0 paycheck contribution options
• Company-paid Health Savings Account (HSA) contribution when enrolled in the High-Deductible medical plan
• Healthcare and Dependent Care Flexible Spending Accounts (FSA)
• 401(k) with employer match, Employee Stock Purchase Plans, and other financial benefits
• Company-paid Basic Life, AD&D, short-term and long-term disability insurance (90-day waiting period)
• Employee Assistance Program
• Sick and vacation time (flex time for salary positions, accrued hours for hourly positions), and paid holidays
• Back-up childcare and parenting support resources
• Voluntary benefits: critical illness, hospital indemnity, accident insurance, theft & legal services, and pet insurance
• Weight loss and tobacco cessation programs
• Tesla Babies program
• Commuter benefits
• Employee discounts and perks program

Pay

Expected compensation: $140,000 - $360,000 annual salary + cash and stock awards + benefits. Pay offered may vary depending on market location, job-related knowledge, skills, and experience.