Strategy Consultant - AI Training & Evaluation (Freelance, Remote)

About the role

Mindrift, powered by Toloka, is launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm.

Responsibilities

• Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information
• Design structured consulting tasks for AI agents — break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more
• Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale

Requirements

• 3+ years of experience at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
• Strong structured problem-solving and hypothesis-driven thinking
• Ability to translate vague problems into clear analytical steps and deliverables
• High attention to logical consistency and output quality
• Independent, self-directed working style
• Clear written English (B2+)

Qualifications

• No deep technical background is required — we will onboard you on the lightweight tools involved

Skills

• No deep technical background is required — we will onboard you on the lightweight tools involved

Benefits

• Compensation on this project can range from $60 per hour equivalent, depending on your level and pace of contribution

Pay

• Compensation varies across projects depending on scope, complexity, and required expertise

Schedule

• This is a remote, project-based, individual-contributor role focused on analytical design and evaluation