Product Manager/Product Owner

Responsibilities

• Assess and compare AI-generated responses to a variety of writing prompts, including specifications, release notes, user-facing copy, and stakeholder updates
• Score each response based on clarity, tone, adherence to instructions, and usefulness for the intended audience
• Write detailed rationales explaining the reasoning behind each score, focusing on whether the content meets prompt requirements and audience needs
• Identify and document cases where fluent writing fails to answer the question, or complete responses are unsuitable for users
• Spot factual inaccuracies, inconsistencies, and instances where content exceeds or misses prompt constraints
• Collaborate virtually and asynchronously with project managers and reviewers to ensure consistency and quality in assessments

Requirements

• Professional experience as a Product Manager or certified Product Owner, with a strong record in cross-functional product development
• Native-level English fluency and exceptional written communication skills
• Extensive experience authoring and evaluating specifications, PRDs, acceptance criteria, release notes, or decision documents
• Demonstrated ability to judge whether content is appropriately tailored for executives, technical stakeholders, or end users
• Proven skill in providing actionable, written feedback on technical or user-facing documentation
• Attention to detail, critical analysis skills, and the ability to work independently while meeting remote project deadlines
• Familiarity with model evaluation, RLHF, or annotation is a plus, but not required

Pay

$90 - $140/hour