Senior Engineer, AV Behavior Evaluation

Office locations: Boston, Las Vegas, Pittsburgh. This role is open to candidates in the U.S. only and supports a hybrid schedule with in-office time in Pittsburgh to support collaboration, or can be fully remote.

About the role

The AV Behavior Design and Evaluation Team owns the design and assessment of AV behavior using the concept of AV behavior competencies. The team systematically decomposes AV behavior and uses data-driven assessment from on-road and simulation test modalities. We build and operate robust, large-scale evaluation systems, sophisticated simulation workflows, and insightful diagnostic tools. By combining expert human judgment with advanced data-driven techniques, we evaluate system behavior performance.

As we scale to support more behavioral competencies, we seek passionate engineers to help build a robust framework that leverages agile systems engineering and data-driven performance assessment. This role involves collaborating across teams to foster a cohesive understanding of AV performance as it applies to behavioral competencies.

Responsibilities

• Propose behavioral expectations on AV capabilities
• Support standardization of metrics used in performance evaluation for AV capabilities to ensure consistency
• Effectively utilize existing metrics and propose new metrics to evaluate AV performance in large-scale simulation testing
• Propose soft/hard targets for metrics using statistical methods and back them with driving data
• Propose and implement ideas to analyze simulation, resimulation, and public road testing results for stakeholders in Systems, Autonomy, Safety, etc.
• Deliver strategic insights and recommendations on projects regarding scenario-based testing
• Build meaningful visualizations and templates for the team to utilize
• Focus on automating result analysis processes and gaps, removing manual processes where applicable
• Support the development, execution, and analyses of test strategy for feature validation
• Communicate test results to development teams and management and facilitate resolving technical issues

Requirements

• Bachelor's degree and 2 years of experience in Engineering, Computer Science, Data Science, or equivalent experience in a relevant industry
• Strong understanding of Autonomous Vehicle architecture and functions of key subsystems such as perception, planning, prediction, etc.
• Experience with analyzing simulation and real-world data for robotic systems, preferably autonomous vehicles
• Fluency in SQL or similar languages
• Fluency in data visualization techniques
• Experience in building Python-based projects for data analysis and insights
• Excellent interpersonal skills to build relationships with other teams
• Excellent communication skills; effective in communicating complex concepts and driving resolutions
• Self-starter who is motivated to set and achieve goals and takes initiative to drive ambiguous tasks/projects to completion

Preferred Qualifications

• Master’s degree in a relevant field
• Experience using simulation tools
• Experience in evaluating Autonomous Driving Behavior using large-scale data
• Familiarity with AV Behavior evaluation standards and best practices

Pay

Salary range: $149,000—$198,500 USD. This range reflects base salary only. The role may include additional forms of compensation such as a bonus or company equity. Benefits include medical, dental, vision, 401k with a company match, health savings accounts, life insurance, pet insurance, and more.