Neuroscience QA Lead - Remote

Key Responsibilities

• Spot-check neuroscience/cognitive science items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
• Evaluate AI-generated neuroscience/cognitive science explanations, research summaries, experimental interpretations, brain-behavior claims, cognitive theory applications, and step-by-step reasoning for accuracy and clarity.
• Communicate with trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and neuroscience/cognitive-science-specific review standards.
• Respond to trainer/QA questions clearly and promptly, especially around neural mechanisms, cognition, experimental design, statistical interpretation, ethical boundaries, clinical caution, and rubric interpretation.
• Manage trainer/QA activation by DMing inactive contributors, encouraging activation, tracking follow-ups, and flagging availability issues when needed.
• Create and maintain neuroscience/cognitive science project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
• Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and neuroscience/cognitive-science-specific review requirements.
• Ensure all trainers and QAs apply neuroscience/cognitive science review guidelines consistently and understand updates as projects evolve.
• Flag pseudoscientific, overconfident, clinically misleading, ethically problematic, or unsupported claims about the brain, cognition, behavior, or mental health.
• Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for neuroscience/cognitive science AI training projects.

About the role

This is an hourly, remote contractor role within a fast-growing AI Data Services company. The role involves overseeing quality, consistency, and trainer performance across neuroscience and cognitive science AI training projects. You will review AI-generated content and provide precise written feedback to ensure adherence to project guidelines.