Geology QA Lead - Remote

Key Responsibilities

• Spot-check geology/earth science items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
• Evaluate AI-generated geology explanations, earth science summaries, geologic process descriptions, map/data interpretations, climate or hazard explanations, and step-by-step reasoning for accuracy and clarity.
• Communicate with trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and geology/earth-science-specific review standards.
• Respond to trainer/QA questions clearly and promptly, especially around geologic timescales, rock/mineral identification, earth systems, natural hazards, spatial reasoning, environmental interpretation, and rubric interpretation.
• Manage trainer/QA activation by DMing inactive contributors, encouraging activation, tracking follow-ups, and flagging availability issues when needed.
• Create and maintain geology/earth science project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
• Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and geology/earth-science-specific review requirements.
• Ensure all trainers and QAs apply geology/earth science review guidelines consistently and understand updates as projects evolve.
• Flag misleading, overconfident, geologically impossible, environmentally unsupported, or poorly contextualized earth science claims.
• Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for earth science/geology AI training projects.

About the role

This hourly, remote contractor role involves overseeing quality, consistency, and trainer performance across geology and earth science AI training projects. You will review AI-generated earth science/geology content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for scientific accuracy, geologic reasoning, terminology quality, spatial and temporal context, unit handling, data interpretation, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently.