Strategy Consultant - AI Training & Evaluation (Freelance, Remote)
Mindrift · Austin, TX · 3 days ago
RemoteRemoteConsulting$60/hrPart-time
About the role
Mindrift, powered by Toloka, is launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. The role is exclusive to consultants with direct experience at top-tier strategy consulting firms.
Responsibilities
- Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information
- Design structured consulting tasks for AI agents — break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more
- Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale
Requirements
- 3+ years of experience at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
- Strong structured problem-solving and hypothesis-driven thinking
- Ability to translate vague problems into clear analytical steps and deliverables
- High attention to logical consistency and output quality
- Independent, self-directed working style
- Clear written English (B2+)
Skills
- No deep technical background required — onboarding provided
Benefits
- Compensation up to $60 per hour equivalent, varying across projects based on scope, complexity, and required expertise
Pay
- Up to $60 per hour equivalent, varying across projects
Schedule
- Remote, project-based, individual contributor role