Senior Engineer, AV Behavior Evaluation

About the role

The AV Behavior Design and Evaluation Team owns the design and assessment of AV behavior using the concept of AV behavior competencies. The team systematically decomposes AV behavior and uses data-driven assessment from on-road and simulation test modalities. Responsibilities include building and operating robust, large-scale evaluation systems, sophisticated simulation workflows, and insightful diagnostic tools. By combining expert human judgment with advanced data-driven techniques, the team evaluates system behavior performance. This role supports scaling behavioral competencies by leveraging agile systems engineering and data-driven performance assessment to advance safer, smarter transportation.

Responsibilities

• Propose behavioral expectations for AV capabilities.
• Support standardization of metrics used in performance evaluation for AV Capabilities to ensure consistency.
• Effectively utilize existing metrics and propose new metrics to evaluate AV performance in large-scale simulation testing.
• Propose soft/hard targets for metrics using statistical methods and back them with driving data.
• Propose and implement ideas to analyze simulation, resimulation, and public road testing results for stakeholders in Systems, Autonomy, Safety, etc.
• Deliver strategic insights and recommendations on projects regarding scenario-based testing.
• Build meaningful visualizations and templates for the team to utilize.
• Focus on automating result analysis processes and removing manual processes where applicable.
• Support the development, execution, and analyses of test strategy for feature validation.
• Communicate test results to development teams and management and facilitate resolving technical issues.

Requirements

• Bachelor's degree and 2 years of experience in Engineering, Computer Science, Data Science, or equivalent experience in a relevant industry.
• Strong understanding of Autonomous Vehicle architecture and functions of key subsystems such as perception, planning, and prediction.
• Experience analyzing simulation and real-world data for robotic systems, preferably autonomous vehicles.
• Fluency in SQL or similar languages.
• Fluency in data visualization techniques.
• Experience building Python-based projects for data analysis and insights.
• Excellent interpersonal skills to build relationships with other teams.
• Excellent communication skills; effective in communicating complex concepts and driving resolutions.
• Self-starter who is motivated to set and achieve goals and takes initiative to drive ambiguous tasks/projects to completion.

Preferred Qualifications

• Master's degree in a relevant field.
• Experience using simulation tools.
• Experience evaluating Autonomous Driving Behavior using large-scale data.
• Familiarity with AV Behavior evaluation standards and best practices.

Benefits

• Medical, dental, and vision coverage.
• 401k with a company match.
• Health savings accounts.
• Life insurance.
• Pet insurance.
• Additional forms of compensation such as a bonus or company equity (role-dependent).

Pay

Salary Range: $149,000 USD - $198,500 USD.

Schedule

Hybrid schedule with in-office time in Pittsburgh to support collaboration, or fully remote.