Artificial Intelligence Specialist

Role Responsibilities

• Create written responses and explanations for complex personal tasks.
• Judge whether outputs are practical, well-reasoned, and appropriately personalized.
• Identify where the AI succeeds, fails, overreaches, or misses important context.
• Apply structured rubrics and quality criteria to assess model performance.
• Use your own LLM experience to evaluate real-world usefulness.

Candidature

• Heavy personal usage of LLM products.
• Experience using AI for multi-step tasks, planning, research, decision-making, or personal workflows.
• Familiarity with tools such as ChatGPT, Claude, Gemini, Perplexity, Cursor, Windsurf, Codex, or other AI agents.
• Ability to explain what makes an AI output good, bad, incomplete, unsafe, or unrealistic.
• Strong written judgment and attention to detail.
• Experience writing and evaluating against rubrics is extremely critical.
• Expertise Domains: Personalized Food Recommendations, Personalized Health Reasoning, Personal Productivity, Personalized Career Advice, Personalized Learning and Development.

Why This Work Matters

LLMs are quickly becoming personal assistants for everyday decisions, but truly useful AI needs to do more than produce generic advice. It needs to understand context, preferences, constraints, tradeoffs, and what success looks like in real life. Your evaluations will help improve how AI systems support people with practical, high-context tasks across food, health, productivity, careers, and learning. This work directly contributes to making AI assistants more personalized, trustworthy, and useful for real-world personal workflows.

Engagement Details

• Expected commitment: 15-40 hours/week.
• Work Trial: Participants will be asked to complete a paid work trial as part of the onboarding process for this project. The work trial pays $30 after completion and is designed to help assess each participant's fit for the role based on LLM experience and domain expertise.
• We recommend putting thoughtful effort into the assessment, as it will play a significant role in the selection process.
• Please note that the project is still in its early stages, and so please expect an initial delay in getting started or tasking.
• Participants will write clear, realistic prompts for complex personal-life tasks, execute those tasks while recording their screens, and create detailed evaluation rubrics to assess how well AI systems perform.
• This work requires both strong ChatGPT power-user experience and firsthand expertise completing challenging, research-intensive personal workflows end-to-end.
• You should be able to turn around tasks within 24 hours.
• A desktop or laptop computer is required (Chromebooks are not supported).