Machine Learning Engineer

Why It Matters

AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying to debug flaky evaluations that just aren't matching real-world results. Evals are like unit tests; they confirm your model got specific test cases right. But in the real world, agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That's where Raindrop comes in. It learns the unique shape of each AI agent's issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties, and more.

About the role

As part of the early team, you'll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents.

Responsibilities

• Build out a world-class product - servicing millions of requests a day + growing
• Architect, implement, and scale ML pipelines
• Quick iteration without compromising on quality
• Deeply understand the customer

Requirements

• Knows how to balance short-term and long-term speed
• Proven experience scaling applications
• Interest in AI products + tools (ideally experience building these or an avid user)
• Growth mindset
• Cares about building well-designed products
• Willing to do whatever it takes to solve a problem

Qualifications

• Must be in person in San Francisco (or willing to move)

Skills

• Strong understanding of machine learning and its applications
• Experience with large-scale distributed systems
• Ability to work independently and manage multiple projects simultaneously

Benefits

• Competitive compensation range: $150K - $250K
• Flexible working arrangements
• Health insurance
• Retirement plans
• Professional development opportunities

Pay

• $150K - $250K

Schedule

• Full-time