Operations Manager | Remote

Participate in a structured evaluation pilot to assess AI model performance on professional tasks. Complete a domain-specific task, evaluate model outputs, and provide feedback.

Responsibilities

• Sign an NDA before receiving any materials.
• Solve one realistic, domain-specific task using the source files provided.
• Review five model-generated outputs for that task, rank them 1–5, score each 0–100, and write evidence-based rationales.
• Provide structured feedback on the task itself and on the study design.

Requirements

• Have strong relevant experience in one of the four domains: Admin, Marketing, HR, or Accounting.
• Currently or recently practicing to judge work as a working professional would.
• Able to write a clear, specific, evidence-grounded rationale for a judgment.

Pay

$60–$80 per hour

Remote