Backend Systems AI Model Trainer - Remote

Responsibilities

• Develop objective criteria (rubrics) to evaluate system performance and ensure outputs meet functional requirements.
• Review system logs and "trajectories" to refactor code, improve execution paths, and achieve high reliability.
• Test systems for vulnerabilities, including data exposure, unauthorized access, and edge-case failures.

Qualifications

• 2+ years of experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production-grade software with modular separation.
• Strong command of at least two major programming languages (e.g., Python, JavaScript, Go, or Java) and experience with SQL databases.
• Practical experience building for live environments and handling multi-turn system interactions.
• Outstanding attention to detail and ability to provide clear, high-density technical feedback.
• Nice to Have: Expertise in building multi-stage coordination tasks, hands-on experience integrating agents with live tools (e.g., Supabase, Gmail, APIs), experience implementing persistent state and session discovery, and experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.

Compensation

• Project Work: Up to $35 USD per hour.
• Additional Incentives: On average, contributors earn an additional 7.5% through "Missions" (surge pricing).
• Top performers can earn up to 11% more.

Additional Information

• This is a 1099 contract opportunity on the Outlier.ai platform.
• Outlier does not offer internships, sponsorship, or employment.
• You must be authorized to work in your country of residence.