Gmail & Google Calendar AI Assistant Evaluator | Farooq77 Jobs

About the role

Evaluate next-generation AI assistants by completing realistic digital tasks involving Gmail, Google Calendar, bookings, scheduling, and coordination, then reviewing and grading assistant performance to improve model quality. Remote contractor opportunity via micro1 application platform.

Posted 2026-09-23; valid through 2026-10-23.

Responsibilities

• Complete realistic everyday digital tasks involving email, scheduling, booking, and coordination using AI assistant tools.
• Provide clear instructions to AI assistants for real-world tasks and carefully verify their work for accuracy and completeness.
• Apply detailed grading guidelines to evaluate, rank, and annotate AI assistant responses and provide structured feedback.
• Test scenarios involving email threads, calendar invitations, online bookings, and multi-person coordination, including diverse situations and edge cases.
• Use AI training tools and platforms to record findings and submit evaluation data according to project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities, refine evaluation guidelines, and maintain consistency.
• Participate in ongoing quality reviews and incorporate feedback to maintain rigorous evaluation standards.

Requirements

• Be based in the United States.
• Have an iPhone with iMessage.
• Have a Facebook or Instagram account.
• Use Gmail and Google Calendar daily for email communication, invitations, scheduling, and managing plans.
• Have regular experience coordinating with others through email or text.
• Be comfortable independently booking restaurants, appointments, travel, deliveries, or similar services online.
• Have experience using AI tools for practical tasks and be comfortable instructing AI assistants and reviewing their work.
• Demonstrate exceptional attention to detail and accuracy when evaluating AI-generated output.
• Have strong written communication skills for clear reporting and timely project updates.
• Demonstrate