LLM Power User - MCP Expert

Role Responsibilities

• Evaluate AI systems on complex personal workflows, including personal health, travel, and activity planning.
• Develop realistic prompts for complex personal-life tasks and execute them while recording your screen.
• Use personal plugins/connectors such as Google Drive, Expedia, and Notion to complete actions.
• Write clear explanations of AI successes and failures, judging practicality and personalization.
• Identify where models miss context or fail to use tools correctly, applying detailed rubrics to assess performance.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Qualifications

• Must-Have: US-based only.
• Strong MCP experience and plugin/connector usage.
• Experience using LLM plugins/connectors such as Google Drive, Expedia, Notion.
• Heavy personal usage of LLM products.
• Active, rich LLM account with regular usage and approximately 6+ months of history.
• Willingness to sign a data-share consent form via DocuSign.
• Experience using AI for multi-step planning, research, decision-making, or personal workflows.
• Strong written judgment and attention to detail.
• Able to explain AI output quality.
• Experience writing and evaluating against rubrics.
• PREFERRED: Extensive rubric experience, including 100+ hours on prior rubric projects.

Compensation & Legal

• Hourly contractor.
• Paid weekly via Stripe Connect.

Application Process

• Takes 20–30 mins to complete.
• Upload resume.
• Submit form.

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome

For any help or support, reach out to: support@mercor.com