Staff Software Engineer - Agent Quality

The Role

The Databricks AI Research organization is pushing the frontier of next-generation enterprise AI. We believe a company's data is its greatest competitive advantage, and we're building the models and agents that unlock it. Our work spans the full stack, from model training to advanced multi-agent systems.

About the role

As a Staff Software Engineer - Agent Quality, you will be a founding member of a new team focused on evaluating and continuously improving Databricks' AI Agents. You will design and scale the infrastructure, tooling, and developer workflows that let researchers and engineers evaluate agents rigorously — driving a flywheel where evaluation results feed directly back into agent improvement across the full lifecycle, from development and training to production.

Responsibilities

• Stand up the foundational evaluation infrastructure for Genie Agents, enabling rigorous benchmarking, regression detection, and quality measurement across research and product teams.
• Build the flywheel that connects evaluation results back into agent improvement — closing the loop between production signals, training, and iterative development.
• Shape the long-term technical direction for agent quality infrastructure, with real influence over how Databricks measures and improves its first-party agents and agent development platform.

Requirements

• 6+ years industry experience building software systems
• Strong Python programming skills, with experience building production or research infrastructure
• Experience building or operating distributed systems, data pipelines, or large-scale infrastructure with a focus on reliability, correctness, and operational maturity
• Ability to design pragmatic but rigorous systems that produce trustworthy, reproducible signals for complex applications
• Comfort working across ambiguous research and product boundaries, and partnering with both researchers and engineers to turn ideas into robust internal platforms
• A high bar for technical quality, strong ownership, and the ability to influence roadmap and execution across multiple teams

Qualifications

• Nice to have: Experience with devtools, CI/CD platforms, testing frameworks, observability tooling, or benchmarking infrastructure
• Nice to have: Familiarity with how LLM or agent quality is measured — whether through evals, experimentation platforms, or production monitoring

Skills

• Strong Python programming skills
• Experience with distributed systems
• Experience with large-scale infrastructure
• Ability to design rigorous systems
• Comfort working across research and product boundaries
• High bar for technical quality

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

Pay

The pay range(s) for this role is $180,000 - $240,000 per year. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above.

Contact

If you have questions about this role, please contact [Contact Information].