Architecture Expert - Task Author

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.

About the role

We are looking for an Architecture Expert to evaluate AI models on visual document understanding in the Architecture domain. This is a contract position with a commitment of 15–20 hours per week, offering $75/hour and fully remote work.

Responsibilities

• Evaluate AI models on visual document understanding in the Architecture domain.
• Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
• Improve AI model performance by shaping model reasoning and outputs.
• Collaborate with subject matter experts to ensure task relevance and accuracy.
• Work independently and asynchronously to meet deadlines and enhance model evaluation.

Requirements

• Expertise in the Architecture domain.
• Experience with AI model evaluation.

Compensation: $75/hour
Schedule: 15–20 hours/week