MCP & Plug In Connectors Expert

About the role

This role is for one of our clients.

Compensation

Compensation: $50-$190 per hour

Join a pioneering AI research initiative

focused on evaluating and improving how advanced AI systems perform complex, real-world personal workflows.

Key Responsibilities

• Design realistic prompts that reflect complex, real-world personal workflows
• Execute multi-step tasks using AI while recording your screen as part of the evaluation process
• Utilize personal AI plugins and connectors throughout workflow execution
• Assess AI-generated outputs for practicality, personalization, reasoning quality, and overall usefulness
• Identify where AI systems fail to understand context, misuse connected tools, overlook constraints, or produce unrealistic recommendations
• Write detailed, structured explanations highlighting AI strengths, weaknesses, and improvement opportunities
• Develop and apply comprehensive evaluation rubrics to measure AI performance consistently across different task types

Areas of Focus

• Personal health and wellness
• Travel planning and itinerary management
• Food, dining, and activity planning
• Home services and maintenance
• Career exploration and job search
• Productivity and personal organization
• Other complex day-to-day life management tasks

Required Qualifications

• Must be based in the United States
• Strong hands-on experience with Model Context Protocol (MCP) and AI plugin/connector ecosystems
• Frequent use of AI plugins/connectors such as Google Drive, Expedia, Notion, and similar productivity platforms
• Heavy personal use of Large Language Models with an established usage history of at least 6 months
• Experience using AI for multi-step planning, research, decision-making, and everyday personal workflows
• Strong analytical thinking, written communication, and attention to detail
• Ability to evaluate AI outputs for accuracy, usefulness, personalization, safety, and reasoning quality
• Willingness to sign a data-sharing consent agreement through DocuSign
• Experience designing, applying, or reviewing structured evaluation rubrics

Preferred Qualifications

• Extensive rubric development and evaluation experience, including 100+ hours working on AI evaluation or quality assessment projects
• Deep familiarity with AI-assisted productivity workflows involving multiple connected applications
• Experience identifying AI limitations and recommending improvements based on real-world usage scenarios

Engagement Details

• Expected commitment: 20+ hours per week
• Initial onboarding and ramp-up period of approximately 1-2 days
• Ability to complete assigned work within 24 hours of task assignment
• Desktop or laptop computer required (Chromebooks are not supported)
• Selected contributors will begin with a trial period to evaluate quality, consistency, and overall project fit
• As this project is in its early stages, there may be a short delay before initial task assignments become available

Equal Opportunity

We are committed to providing equal opportunities to all qualified applicants. Reasonable accommodations are available throughout the application and engagement process.

Contract & Engagement Details

• Independent contractor engagement
• Full-time remote with flexible working hours
• Project timelines may be extended, shortened, or concluded based on project requirements and individual performance
• Work does not require access to confidential or proprietary information from any current or former employer
• Payments are issued weekly based on approved work completed through supported payment platforms
• At this time, we are unable to support H1-B or STEM OPT candidates