Agentic AI Software Engineer (AI Training - OpenClaw)

About the role

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. This freelance role is fully remote and offers flexible hours.

Responsibilities

• Developing objective, verifiable criteria (rubrics) to evaluate system performance and ensure outputs meet strict functional requirements.
• Reviewing system logs and "trajectories" to refactor code, improve execution paths, and reach a "Golden Path" of perfect reliability.
• Testing systems for vulnerabilities, including improper data exposure, unauthorized access escalations, and edge-case failures.

Requirements

• 2+ years of experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting).
• Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases.
• PRACTICAL experience building for live, non-mocked environments and handling multi-turn system interactions.

Qualifications

• OUTSTANDING attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.

Skills

• Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output.
• Hands-on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems.
• High level of comfort implementing persistent state and session discovery using MEMORY.md to track agent progress.
• Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.

Benefits

• Earn up to USD $55 per hour for core project work.
• Average additional 7.5% on top of the core project rates through Missions — Outlier's version of surge pricing.
• The top quartile of contributors boost their earnings by an average of 11%.
• Rates vary based on expertise, skills assessment, location, project need, and other factors.

Pay

• Project work: Earn up to USD $55 per hour for core project work.
• Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions.

Schedule

• Freelance role with flexible hours.