Senior Staff TLM, Data Mining and Sampling for ML and Evaluation

Job Summary

The Waymo Driver Evaluation Team is looking for an experienced, technically hands-on engineering manager to lead a small team and work with partners to scale evaluation and machine learning development. This role will develop tools for mining novel situations from driving logs, build advanced sampling techniques, and automate the mining and sampling ecosystem. The ideal candidate will provide strong management and technical leadership for a small team of data science-friendly engineers, partner with cross-functional teams, and contribute to both engineering and data science projects.

About the Role

The Waymo Driver Evaluation Team is responsible for ensuring that the Waymo Driver can safely operate in new cities and countries. This involves evaluating safety and service quality, which requires developing tools and techniques for mining and sampling data.

Responsibilities

• Develop tools for easy mining of novel situations that might impact safety from our driving logs for use in evaluation and ML datasets, using a mixture of ML and structured data
• Build advanced sampling techniques and tuning of simulations to get strong signal for metrics and models from our datasets
• Make automation for our mining and sampling ecosystem so Waymo can rapidly scale to new cities
• Make hands-on technical contributions to both engineering and data science-oriented projects
• Provide strong management and technical leadership for a small team of data science-friendly engineers
• Partner with leads and teams across Waymo to determine and execute on strategy, including product, engineering, data science, frontend, and backend

Requirements

• Strong engineering design and programming skills
• Strong data fluency and analysis skills
• Familiarity with statistical methods including hypothesis testing, experiment design, and sampling
• Familiarity with foundational and contemporary ML concepts and practices
• Experience managing teams of up to 8 people
• Bachelor's or Master's degree in Computer Science, Robotics, Statistics, Physics, Math, or other quantitative area
• 7+ years of industry experience with:
• C++, SQL, and Python experience
• Navigating and modifying a large code base containing C++, SQL, and Python
• Building data processing pipelines

Qualifications

• Eval experience, such as building and validating metrics to measure quality in complex systems
• Strong statistical background (MSc-level stats or similar expertise from work experience)
• Strong ML background (MSc-level ML or similar expertise from work experience)
• Experience working in the AV industry and/or with simulations

Benefits

The Waymo team offers a competitive salary range of $281,000—$356,000 USD, along with a variety of benefits including a discretionary annual bonus program, equity incentive plan, and generous Company benefits program. Employees are also eligible to participate in Waymo’s benefits program, subject to eligibility requirements.