English (US) Google Workspace AI Personalization Rater

About The Opportunity

Help our client improve how AI systems personalize responses for professionals. In this remote contractor assignment, you will review AI-generated answers using authorized professional email history as context. You will judge whether each response is relevant, accurate, helpful, and appropriately personalized. Your careful, objective feedback will help improve the quality and reliability of future AI experiences.

What you will do

• Audit AI-generated responses for relevance, accuracy, helpfulness, and appropriate personalization.
• Compare multiple responses and determine which delivers the stronger overall experience.
• Identify unsupported assumptions, incorrect personalization, irrelevant recommendations, and subtle inconsistencies.
• Provide clear, detailed, and well-reasoned written feedback on your judgments.
• Follow evaluation guidelines consistently while protecting privacy and maintaining confidentiality.

What we are looking for

• Strong English (US) proficiency, including the ability to read and evaluate nuanced written content.
• An active Google Workspace account used regularly for professional communication.
• A Gmail interface or display language set to English, with the majority of inbox content in English.
• Absence of privacy and confidentiality issues.
• Authorization to use the qualifying Google Workspace account's email history for this evaluation project.
• A bachelor's degree or equivalent practical experience in any field.
• At least two years of professional experience.
• Strong analytical judgment, attention to detail, and the ability to work independently in a remote setting.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical area is helpful but not required.

Engagement details

• Remote contractor assignment with an immediate start.
• Expected duration of 12 to 16 weeks.
• At least 4 hours of availability per day, up to 40 hours per week.
• At least 4 hours of working-time overlap with Pacific Time.

Pay

$12 USD per hour.