Member of Technical Staff: Policy Evaluation & Experiment Infrastructure
Walden Robotics · Cambridge, MA · 2 mo ago
EngineeringFull-time
You will build the tooling that lets the autonomy team measure whether our robot policies are actually getting better—in simulation and on real hardware. This is a high-leverage engineering role at the center of the research loop, close to real robot behavior, with strong mentorship and room to grow quickly alongside senior engineers.
Responsibilities
- Policy Evaluation: Build and maintain the pipelines that evaluate robot policies—in sim and on hardware—and the experiment-tracking tooling the team uses daily.
- Metrics for Robot Behavior: Implement task-success metrics, dashboards, and automated checks that turn messy robot rollouts into trustworthy, comparable signal.
- Iteration Speed: Improve the speed and reliability of the experiment loop so researchers can evaluate policies faster.
- Debugging: Track down issues across the evaluation stack and in policy rollouts—from flaky jobs to misleading metrics to surprising robot behavior.
- Growth: Learn the autonomy stack alongside senior engineers and take on growing ownership.
Requirements
- Software Fundamentals: Solid engineering fundamentals and a bias toward building reliable, well-tested tooling.
- Robot Policies: Hands-on experience working with robot policies or robotic systems—running, evaluating, or debugging them (research, projects, or industry).
- ML Systems Interest: Genuine interest in ML systems and evaluation, and enthusiasm for working where research meets real robots.
- Delivery: The ability to take a well-scoped problem and deliver it end to end.
- Curiosity & Drive: Eagerness to learn quickly from feedback and code review.
Preferred Qualifications
- Experience evaluating or benchmarking robot policies in simulation or on hardware.
- Exposure to ML experimentation, evaluation, or data pipelines.
- Familiarity with Python and with cloud or compute infrastructure.
Benefits
- Competitive total compensation program, including salary, annual cash bonus, and company equity.
- Company-subsidized insurance programs.
- 401(k) with company match.
- Flexible PTO.
- Daily lunch.
- Other benefits.