AI Evaluator | $30/hr Remote

About the role

Contractor position, fully remote. Compensation: $15–$30/hour. Expected commitment: 10–40 hours per week.

Responsibilities

• Complete realistic, everyday digital tasks using AI assistant tools under standardized conditions.
• Give an AI assistant clear instructions for real-world tasks and verify its work for accuracy.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses.
• Test scenarios involving email threads, calendar invites, and multi‑person coordination.
• Utilize AI training tools to record findings and submit evaluation data.
• Collaborate with project trainers to resolve ambiguities and refine guidelines.
• Participate in ongoing quality reviews to maintain rigorous evaluation standards.

Requirements

• Daily, hands‑on use of Gmail and Google Calendar for personal management tasks.
• Regular experience coordinating with others over email or text.
• Comfort booking things online independently, such as restaurants or travel.
• Experience using AI tools for practical tasks, with comfort giving instructions and checking work.
• Exceptional attention to detail and accuracy when reviewing AI‑generated output.
• Strong written communication skills for clear reporting and updates.
• Demonstrated time management and self‑organization for independent, remote project participation.