Data Quality Analyst (Chinese) | $20/hr Remote

Short-term contractor assignment (4 months) – remote, up to 40 hours per week with 4 hours overlap with PST.

Responsibilities

• Design and execute multi-turn prompts using personal context and experiences.
• Evaluate AI responses for personalization, grounding, integration, and helpfulness.
• Compare and rank AI-generated responses side-by-side based on quality and relevance.
• Identify incorrect personalization, unsupported inferences, hallucinations, and unnatural responses.
• Provide clear, structured rationales and detailed feedback on model performance.
• Review data usage and maintain proper evaluation and data hygiene.

Requirements

• Strong Chinese language proficiency, including reading and writing.
• Experience in AI evaluation, data annotation, content moderation, or a related analytical role is preferred.
• Strong analytical and critical-thinking skills with the ability to evaluate nuanced AI responses.
• Experience designing creative, multi-turn prompts and assessing personalization quality.
• Excellent written communication and ability to provide clear, evidence-based evaluation rationales.
• Active user of a personal Google account and willing to enable required personal data sources.

Pay

$15 - $20 per hour