Domain Expert, AI Evaluation (Law)

About the role

We are hiring experienced legal professionals to contribute to AI evaluation projects by creating high-quality legal reasoning tasks that assess the capabilities of advanced AI systems. This specialist role is designed for legal practitioners who can apply their professional expertise to create realistic legal scenarios, identify complex reasoning challenges, and provide accurate, defensible legal analyses.

Key Responsibilities

• Design original legal tasks based on real-world legal practice.
• Produce accurate, fully reasoned, and defensible "golden answers."
• Develop challenging legal reasoning scenarios that expose limitations in advanced AI systems.
• Ensure all deliverables meet defined quality, formatting, and accuracy standards.
• Complete assigned tasks independently before beginning the next assignment.
• Incorporate reviewer feedback while maintaining consistent quality across submissions.

Required Qualifications

• Education & Experience:
• Juris Doctor (JD) or an equivalent recognized professional law qualification.
• Minimum 2 years of professional legal experience.

Required Skills

• Strong legal expertise and current knowledge of legal practice.
• Excellent legal analysis and reasoning skills.
• Outstanding written English communication skills.
• Strong attention to detail.
• Able to work independently in a structured environment.

Requirements

• Full-time availability during the engagement.
• Personal laptop with a modern browser.
• Reliable high-speed internet connection.

Compensation

Competitive task-based payment for every approved submission. Earnings depend on the quality and number of completed tasks. Detailed payment structure will be shared during onboarding.

Onboarding & Work Integrity

• Successful completion of the project onboarding assessment is required.
• All deliverables must be original, human-authored work.
• AI writing, editing, or grammar assistance tools are strictly prohibited.
• Employment is subject to signing a Non-Disclosure Agreement (NDA).