English Speaking Generalist

Role Responsibilities

• Create diverse prompts across various topics to challenge large language models.
• Submit identical prompts to ChatGPT and Claude, recording screen and microphone.
• Articulate comparisons and evaluate outputs from both models in real time.
• Provide detailed verbal feedback in clear American English, explaining reasoning and preferences.
• Interpret documentation to ensure consistent evaluation standards and accurate project delivery.
• Collaborate with project guidelines to support continuous improvement of AI models.

Requirements

• High-level fluency in spoken and written American English with clear pronunciation.
• Experience using large language models such as ChatGPT, Claude, or similar platforms.
• Familiarity with AI evaluation tasks.
• Comfortable recording screen and audio for extended evaluation sessions.
• Background in data annotation, AI training, quality assurance, content evaluation, or research is advantageous.
• Strong technical setup, including a reliable computer and stable internet connection.