Agent Engineer

About the role

We’re looking for Agent Engineers to build systems that generate, test, monitor interfaces at scale. This team enables the creation of hundreds of thousands of on-brand, production-ready experiences (Web and beyond) with strong automated QA loops and continuous monitoring systems. Each improvement here increases optimization space, experimentation velocity, and thus, lift.

Responsibilities

• Build AI agents that generate interfaces, client-side features, and more at scale.
• Create validation systems that catch bugs, off-brand outputs, and poor user experiences before launch.
• Build online and offline evaluation systems for generated outputs.
• Build monitoring systems that detect issues and regressions after rollout.
• Improve orchestration between generation, QA, rollout, and learning loops.
• Consistently turn manual workflows into scalable and reliable agents.
• Talk to technical and non-technical teams to capture qualitative feedback and convert it to the metrics and improvements.

Requirements

• Built production AI systems, agent workflows, LLM pipelines
• Strong software engineering fundamentals and ability to ship reliable non-derministic systems
• Experience with LLMs, tool use, evaluation systems, and parallel execution
• Strong web experience and product sense for what good outputs look like
• Strong communication skills to talk to customer, non-technical partners to convert requirements into technologies and processes

Qualifications

• Commensurate with experience

Skills

• Built production AI systems
• Agent workflows
• LLM pipelines
• Software engineering fundamentals
• Experience with LLMs, tool use, evaluation systems, and parallel execution
• Strong web experience
• Product sense
• Communication skills

Benefits

• Flexible (Unlimited) Paid Time Off
• Medical, Dental, and Vision benefits for you and your family
• Life Insurance and Disability Benefits
• 401k Plan with Coframe match
• Meals covered in-office
• Gym membership

Pay

Compensation Range: $180K - $500K

Schedule

Primarily in-person company based in San Francisco