Geology Quality Assurance Lead (QAL)

Key Responsibilities

• Spot-check geology/earth science items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
• Evaluate AI-generated geology explanations, earth science summaries, geologic process descriptions, map/data interpretations, climate or hazard explanations, and step-by-step reasoning for accuracy and clarity.
• Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and geology/earth-science-specific review standards.
• Respond to trainer/QA questions clearly and promptly, especially around geologic timescales, rock/mineral identification, earth systems, natural hazards, spatial reasoning, environmental interpretation, and rubric interpretation.
• DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed.
• Create and maintain geology/earth science project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
• Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and geology/earth-science-specific review requirements.
• Ensure all trainers and QAs apply geology/earth science review guidelines consistently and understand updates as projects evolve.
• Flag misleading, overconfident, geologically impossible, environmentally unsupported, or poorly contextualized earth science claims.
• Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for earth science/geology AI training projects.

Requirements

• Bachelor’s, Master’s, or PhD degree in Geology, Earth Sciences, Geoscience, Environmental Science, Geophysics, Geochemistry, Hydrology, Paleontology, Oceanography, or a closely related field.
• Strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear written feedback.
• 3+ years of experience in geology/earth science research, teaching, fieldwork, environmental consulting, geospatial analysis, academic review, science communication, or related workflows.
• Strong understanding of plate tectonics, rock cycle, mineralogy, stratigraphy, geologic time, structural geology, geomorphology, natural hazards, climate systems, hydrology, and earth system processes.
• The ability to evaluate earth science/geology content against detailed rubrics and identify issues such as incorrect geologic processes, wrong timescales, misleading causal claims, flawed map/data interpretation, unsupported environmental claims, or oversimplified explanations.
• Familiarity with tools or methods such as GIS, remote sensing, geologic mapping, field methods, core/log interpretation, geochemical data, climate datasets, Python/R, or scientific visualization is preferred.
• Experience leading or supporting remote teams of researchers, educators, reviewers, environmental specialists, annotators, or QAs is strongly preferred.
• Comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Highly detail-oriented and organized, with the ability to maintain style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
• Experience with AI training, data annotation, LLM evaluation, scientific QA, academic review, or rubric-based review is a strong plus.