Task Designer, Knowledge Work

The role Financial analysis, research synthesis, operations planning, customer resolution. These are the tasks where models answer well and work poorly. You’ll design tasks that require multi-step reasoning over documents, data and tools, and define what a defensible answer looks like. What you’ll own Tasks grounded in realistic documents, spreadsheets, records and policies.Rubrics that separate a correct answer from a confident one, co-authored with domain experts.Document collections and data fixtures with planted conflicts, gaps and distractors.Difficulty calibration against expert completion rates and model baselines.A clean line between training tasks and held-out evaluation tasks. What you bring A background in a knowledge profession: finance, consulting, research, operations, analytics.You write clearly and structure ambiguous problems well.Spreadsheets, SQL or scripting to build and check fixtures.Respect for evidence. You want claims traced to sources. Helpful, not required Assessment, case study or examination design.Familiarity with how language models are evaluated.