Freelance Legal Specialist

About the role

Uber AI Solutions connects qualified legal professionals with client-led Generative AI research initiatives. As an early-career Legal Domain Expert, you will leverage your practical training in legal research, citation analysis, and statutory interpretation to help evaluate and train next-generation legal LLMs. In this role, you will apply hands-on legal reasoning to conduct rigorous citation reviews, construct fine-grained evaluation rubrics, analyze complex agent trajectories, and audit AI outputs for hallucinations and procedural errors. Disclaimer: This engagement involves hands-on legal analytical work for Generative AI evaluation. It does NOT constitute the practice of law, creates no attorney-client relationship, and involves no client representation or legal advice.

Responsibilities

• Citation & Authority Auditing: Perform rigorous verification of primary and secondary authority citations produced by legal AI models to detect hallucinated case law, misquoted statutory provisions, and invalid citations.
• Prompt & Scenario Engineering: Conceptualize and draft realistic, multi-step legal scenarios grounded in primary source documents (statutes, regulations, court opinions, contracts, and filed pleadings).
• Rubric Development & Ground Truth Creation: Build objective evaluation rubrics and author publication-grade "golden" responses adhering to precise Bluebook/local citation and legal drafting standards.
• Failure Mode & Trajectory Analysis: Red-team model outputs to document failure modes, including secondary authority confusion, jurisdiction over-generalization, and errors in multi-document synthesis or deadline computations.
• Workflow Compliance: Complete onboarding calibration, run self-directed quality assurance checks, and incorporate peer reviewer feedback into final submissions.

Qualifications & Experience

Education & Experience: Juris Doctor (JD), LLM, or bachelor’s degree in legal studies with 1–2 years of post-graduate experience in legal research, paralegal work, litigation support, or law firm practice.

Core Competencies: Strong command of legal research tools (Westlaw, LexisNexis, Casetext), primary source document analysis, and rigorous legal citation checking (e.g., Bluebook).

Jurisdictional Tracks: Priority interest in US Corporate, US Securities, US Labor or commercial litigation.

AI Familiarity: Experience or strong interest in Generative AI evaluation, prompt testing, RLHF, data annotation, or golden-answer authoring is a plus.