History Quality Assurance Lead (QAL)

Key Responsibilities

• Quality monitoring: Spot-check history items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
• Historical review: Evaluate AI-generated history explanations, timelines, comparisons, summaries, source-based answers, and reasoning for accuracy, context, balance, and clarity.
• Trainer and QA communication: Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and history-specific review standards.
• Question handling: Respond to trainer/QA questions clearly and promptly, especially around chronology, historical context, source interpretation, disputed interpretations, bias, regional nuance, and rubric interpretation.
• Trainer/QA activation management: DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed.
• Documentation: Create and maintain history project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
• Onboarding and training: Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and history-specific review requirements.
• Quality alignment: Ensure all trainers and QAs apply historical-review guidelines consistently and understand updates as projects evolve.
• Risk and bias review: Flag misleading, overconfident, biased, culturally insensitive, anachronistic, or poorly sourced historical claims.
• Process improvement: Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for history AI training projects.

Requirements

• Bachelor’s, Master’s, or PhD degree in History, Classics, Area Studies, Archaeology, Political History, Cultural History, International Relations, Humanities, or a closely related field.
• Strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear written feedback.
• 3+ years of experience in historical research, teaching, writing, editing, academic review, museum/archival work, curriculum development, or related humanities workflows.
• Strong understanding of historical methods, chronology, primary vs secondary sources, historiography, causation, continuity/change, regional context, and evidence-based interpretation.
• Ability to evaluate historical content against detailed rubrics and identify issues such as anachronism, incorrect chronology, unsupported claims, oversimplification, biased framing, fabricated citations, or misleading causal explanations.
• Familiarity with one or more historical specializations such as ancient history, medieval history, modern history, world history, military history, intellectual history, social history, economic history, colonial/postcolonial history, or regional history is preferred.
• Experience leading or supporting remote teams of researchers, writers, reviewers, educators, annotators, or QAs is strongly preferred.
• Comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Highly detail-oriented and organized, with the ability to maintain style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
• Experience with AI training, data annotation, LLM evaluation, academic QA, fact-checking, or rubric-based review is a strong plus.