AI Quality Analyst – Personalization | English (US)

About the role

We are looking for analytical professionals to support an AI quality evaluation project focused on personalized AI interactions. The role involves designing conversational prompts, reviewing AI-generated responses, and providing structured feedback on their quality, relevance, and personalization.

Responsibilities

• Create and evaluate multi-turn conversational prompts
• Review AI responses for accuracy, relevance, and helpfulness
• Compare responses and identify quality differences
• Evaluate personalization and potential incorrect inferences
• Provide clear, structured evaluation feedback

Requirements

• Strong written and spoken English
• Excellent analytical and critical-thinking skills
• Strong attention to detail
• Ability to evaluate AI responses objectively
• Experience in AI evaluation, data annotation, content moderation, research, linguistics, or related fields is preferred
• Comfortable working independently
• Access to a desktop/laptop and reliable internet

Eligible Locations

• Alabama
• Arizona
• Colorado
• Florida
• Idaho
• Iowa
• Kentucky
• Michigan
• Minnesota
• Mississippi
• Missouri
• Montana
• New York
• North Carolina
• North Dakota
• Oklahoma
• Pennsylvania
• South Carolina
• South Dakota
• Texas
• Virginia
• Wisconsin
• Wyoming

Skills

• annotation
• english
• personalization