System Integration Specialist | Remote

Type: Hourly contract
Location: Remote
Commitment: 10-40 hrs/week
Commission: $50-$190 per hour

What You'll Be Doing

• Create realistic prompts for complex personal-life tasks
• Execute tasks and actions while recording your screen
• Use personal plugins/connectors while completing actions
• Write clear explanations of AI successes and failures
• Judge whether AI outputs are practical, personalized, and well-reasoned
• Identify where models miss context, overreach, or produce unrealistic results
• Create and apply detailed rubrics to assess model performance

Requirements

• Have strong MCP experience and plugin/connector usage
• Experience using LLM plugins/connectors such as Google Drive, Expedia, Notion
• Candidates must be at least 21 years old
• Willingness to sign a data-share consent form via DocuSign
• Experience using AI for multi-step planning, research, decision-making, or personal workflows
• Strong written judgment and attention to detail
• Ability to explain what makes an AI output good, bad, incomplete, unsafe, or unrealistic
• Extensive rubric experience, including 100+ hours on prior rubric projects