Rubrics Grader - Fully Remote | Upto $175/hr

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Responsibilities

• Evaluate model outputs against defined grading rubrics to ensure accuracy and consistency.
• Parse, read, and understand JSON-based outputs for grading purposes.
• Review task descriptions and rubrics to maintain grading standards.
• Work independently and complete tasks within 12–24 hours.
• Ensure attention to detail and consistency in applying rubric criteria.

Requirements

• Available to start this weekend (Sat, July 25).
• Comfortable reading and interpreting JSON files.
• Based in the US.

Qualifications

• Prior experience with Mercor and applying detailed rubrics (preferred).

Start Date: Saturday, July 25; applications reviewed on a rolling basis.

Pay

$50–$175/hour