Legal Domain Expert (SME) – AI Model Evaluation
The Legal Domain Expert (SME) – AI Model Evaluation role requires a licensed attorney, legal researcher, senior paralegal, or similar legal professional with at least 3 years of relevant experience in one of the following specialties: US Corporate Law, US Securities Law, US Employment & Labor Law, Philippines Corporate Law, or China IP / Patent Law. Key responsibilities include evaluating AI-generated legal research, analysis, and responses for accuracy, relevance, completeness, and quality; verifying legal citations, authorities, statutes, cases, regulations, and other supporting sources; assessing legal reasoning for logical soundness, appropriateness, and accuracy; identifying factual inaccuracies, unsupported assertions, misleading conclusions, reasoning gaps, and other substantive issues; evaluating legal drafting for clarity, precision, completeness, and adherence to applicable legal standards; developing and applying objective evaluation criteria, scoring frameworks, and rubrics; providing structured, detailed feedback that clearly explains identified issues; and participating in an initial calibration exercise.
Requirements
- Licensed attorney, legal researcher, senior paralegal, or another legal professional with verifiable qualifications relevant to the applicable jurisdiction.
- Substantial expertise in at least one applicable legal specialty, including knowledge of the relevant jurisdiction and ability to conduct sophisticated legal research and analysis.
- Strong knowledge of the relevant jurisdiction and demonstrated ability to conduct sophisticated legal research and analysis.
- Verifiable bar admission, legal license, academic qualification, or other relevant professional credentials.
- Excellent legal writing, analytical reasoning, fact-checking, and attention-to-detail skills.
- Ability to evaluate legal arguments objectively and identify subtle factual, jurisdictional, citation, and reasoning errors.
- Strong understanding of applicable statutes, regulations, case law, legal authorities, and professional standards within your area of specialization.
- Experience with relevant areas such as entity governance, corporate formation, commercial disputes, fiduciary duties, transactional drafting, FINRA and SEC compliance, FMLA/FLSA, wage and hour law, restrictive covenants, commercial contracts, registry compliance, CNIPA standards, patentability, inventive-step analysis, patent examination, or claims drafting is highly relevant.
Benefits
- USD $46/hour compensation.
- Fully remote engagement within the United States.
- Flexible contract work structured around evaluation assignments.
- Potential for ongoing and recurring assignments following successful initial calibration.
- Opportunity to apply professional legal expertise to the evaluation and improvement of AI-generated legal content.
- Independent work environment suited to experienced legal practitioners and researchers.