Neuroscience QA Lead - Remote

Key Responsibilities

• Spot-check neuroscience/cognitive science items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
• Evaluate AI-generated neuroscience/cognitive science explanations, research summaries, experimental interpretations, brain-behavior claims, cognitive theory applications, and step-by-step reasoning for accuracy and clarity.
• Communicate with trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and neuroscience/cognitive-science-specific review standards.
• Respond to trainer/QA questions clearly and promptly, especially around neural mechanisms, cognition, experimental design, statistical interpretation, ethical boundaries, clinical caution, and rubric interpretation.
• Manage trainer/QA activation by DMing inactive contributors, encouraging activation, tracking follow-ups, and flagging availability issues when needed.
• Create and maintain neuroscience/cognitive science project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
• Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and neuroscience/cognitive-science-specific review requirements.
• Ensure all trainers and QAs apply neuroscience/cognitive science review guidelines consistently and understand updates as projects evolve.
• Flag pseudoscientific, overconfident, clinically misleading, ethically problematic, or unsupported claims about the brain, cognition, behavior, or mental health.
• Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for neuroscience/cognitive science AI training projects.

About the role

This is an hourly, remote contractor role where you will oversee quality, consistency, and trainer performance across neuroscience and cognitive science AI training projects. You will review AI-generated content and provide precise written feedback to ensure all contributors adhere to the expected quality standards.