LLM Power User - Fully Remote | Upto $190/hr

Role Responsibilities

• Evaluate AI systems on complex personal workflows, including personal health, travel, and activity planning.
• Develop realistic prompts for complex personal-life tasks using Google Drive, Expedia, Notion, and other plugins/connectors.
• Execute tasks and actions while recording your screen to provide clear evidence of AI performance.
• Write detailed explanations of AI successes and failures, focusing on practicality and personalization.
• Identify where models miss context or fail to use tools correctly, and create detailed rubrics to assess performance.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Qualifications

• Must-Have:
• Strong MCP experience and plugin/connector usage.
• Experience with GPT plugins/connectors like Google Drive, Expedia, Notion.
• Heavy personal usage of LLM products.
• Active ChatGPT account with 6+ months history.
• Willingness to sign a ChatGPT data-share consent form via DocuSign.
• Experience in multi-step planning, research, decision-making, or personal workflows.
• Strong written judgment and attention to detail.
• Experience writing and evaluating against rubrics.
• PREFERRED:
• Extensive rubric experience, including 100+ hours on prior projects.

Compensation & Legal

• Paid hourly at $50–$190 per hour.
• Paid weekly via Stripe Connect.

Application Process

• Takes 20–30 minutes to complete.
• Upload resume.
• Submit form.

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome

For any help or support, reach out to: support@mercor.com