English AI Quality Analyst - Personalization

About the role

Help improve personalized AI experiences by testing how well AI uses relevant information from prior conversations and connected online activity.

Responsibilities

• Design realistic prompts based on your own experiences.
• Run short, multi‑turn prompts that require meaningful personalization.
• Compare model responses side by side.
• Assess grounding, integration, helpfulness, naturalness, and unsupported inferences.
• Write clear, evidence‑based rationales that reference specific turns.
• Review debug information and maintain clean evaluation conversations.

Requirements

• Strong English reading and writing ability.
• Willingness to use your primary personal Google account.
• Excellent analytical judgment, attention to detail, and concise written communication.
• Ability to work independently on a remote team using a reliable computer and internet connection.
• A bachelor’s degree or equivalent practical experience in an analytical field.

Preferred Background

• At least one year of experience in data annotation, AI quality evaluation, content moderation, prompt evaluation, or related analytical work.
• Experience evaluating nuanced AI responses or writing structured comparative rationales.

Pay

$19 USD per hour.

Schedule

Remote freelance project for candidates based in the United States; expected duration approximately four months. Choose a 30‑ or 40‑hour weekly commitment, with at least four hours per day and four hours of overlap with Pacific Time.