Legal Quality Assurance Lead
Role Description
In this hourly (up to $120), remote contractor role, you will work as a Legal Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across legal AI training projects. You will review AI-generated legal content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards.
Key Responsibilities
Quality monitoring: Spot-check legal items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
Legal review: Evaluate AI-generated legal explanations, legal research responses, contract analyses, policy interpretations, case summaries, compliance guidance, and issue-spotting workflows for accuracy, clarity, and appropriate caution.
Trainer and QA communication: Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and legal-review-specific standards.
Question handling: Respond to trainer/QA questions clearly and promptly, especially around legal reasoning, jurisdiction, citations, source quality, disclaimers, contract language, compliance interpretation, and rubric application.
Trainer/QA activation management: DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed.
Documentation: Create and maintain legal project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
Onboarding and training: Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and legal-specific review requirements.
Quality alignment: Ensure all trainers and QAs apply legal-review guidelines consistently and understand updates as projects evolve.
Risk and safety review: Flag unsafe, misleading, overconfident, or jurisdictionally inappropriate legal outputs, especially where the content could be interpreted as personalized legal advice.
Process improvement: Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for legal AI training projects.