Engineer, Robotics and Hardware

About the role

We're looking for talented researchers and engineers to join us on our mission to build the Safe Autonomous Organization. We prepare for a future where organizations are run autonomously by AI by benchmarking and deploying frontier AI in real-world scenarios.

Safety from humans in the loop is a mirage. As AI capabilities increase, model alignment won't be guaranteed, and humans won't be able to stay in the loop or keep up with every step an AI agent takes. We iteratively launch and scale autonomous organizations, bridging AI control research with real-world testing to build the Safe Autonomous Organization.

Projects & Benchmarks

• Vending-Bench 2 & Arena: A benchmark where AI models manage a simulated vending machine business for a full year, navigating adversarial suppliers, negotiations, and customer complaints while maximizing profits. Models can also compete with each other in Vending-Bench Arena.
• Andon FM: An experiment where AI agents run radio stations, building unique personalities and turning a profit over months.
• Blueprint-Bench 2: Tests AI models' spatial intelligence by converting apartment photographs into accurate 2D floor plans. Most models perform at or below random baseline, while humans significantly outperform AI systems.
• Drone-Bench: Measures how well AI models can write code to surveil real-world environments using low-cost drone hardware.
• Butter-Bench: Evaluates LLM-controlled robots in practical intelligence tasks, such as delivery in household settings. State-of-the-art models score 40%, compared to 95% for humans.
• Real-world deployments:
  • AI-run café in Stockholm (Mona) and retail space in San Francisco (Luna), handling leases, hiring, pricing, inventory, and design.
  • Claude (Anthropic) running a vending machine business in Anthropic's office for a month.

Collaboration

We work with the world's leading AI labs to test and deploy frontier AI models in real-world environments.

Contact

Interested in what we do? Get in touch at founders (at) andonlabs.com.