Neuroscience QA Lead - Remote
YO IT Consulting · Los Angeles, CA · 3 wk ago
RemoteRemoteQuality AssuranceFull-time
Key Responsibilities
- Quality monitoring: Spot-check neuroscience/cognitive science items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
- Scientific review: Evaluate AI-generated neuroscience/cognitive science explanations, research summaries, experimental interpretations, brain-behavior claims, cognitive theory applications, and step-by-step reasoning for accuracy and clarity.
- Trainer and QA communication: Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and neuroscience/cognitive-science-specific review standards.
- Question handling: Respond to trainer/QA questions clearly and promptly, especially around neural mechanisms, cognition, experimental design, statistical interpretation, ethical boundaries, clinical caution, and rubric interpretation.
- Trainer/QA activation management: DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed.
- Documentation: Create and maintain neuroscience/cognitive science project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
- Onboarding and training: Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and neuroscience/cognitive-science-specific review requirements.
- Quality alignment: Ensure all trainers and QAs apply neuroscience/cognitive science review guidelines consistently and understand updates as projects evolve.
- Safety and ethics review: Flag pseudoscientific, overconfident, clinically misleading, ethically problematic, or unsupported claims about the brain, cognition, behavior, or mental health.
- Process improvement: Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for neuroscience/cognitive science AI training projects.
About the role
In this hourly, remote contractor role, you will work as a Neuroscience Quality Assurance Lead to oversee quality, consistency, and trainer performance across neuroscience and cognitive science AI training projects. You will review AI-generated neuroscience/cognitive science content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards.