Knowledge Expert Coder - Legal
Rose International · United States · 1 wk ago
RemoteRemoteEngineeringFull-time
Remote, USA • Temporary • Full-Time • 3-month engagement • $125.00/hour
About the role
We are seeking experienced legal professionals to provide subject-matter expertise ensuring quality standards for our AI training data. This remote role partners closely with AI research and engineering teams to advance cutting-edge technologies.
Responsibilities
- Guide research teams to close knowledge gaps and improve AI model performance, focused on your specialty sub-domain area of practice.
- Collaborate with other subject-matter experts to ensure consistency and accuracy in training data with respect to legal reasoning and content.
- Create, edit, and maintain high-quality annotation guidelines tailored to your sub-domain area of practice, setting the gold standard for data quality and rigor.
- Evaluate and grade the quality of annotations produced by vendors, identify areas of improvement, and provide feedback to optimize annotation quality.
- Directly annotate data for key tasks across the model development life cycle.
Requirements
- LL.B / J.D., LL.M, LL.D, or Ph.D in a law-related field; valid Bar licensure.
- Minimum of 10+ years in the legal space (e.g., teaching law at a post-secondary institution, working at a law firm, in-house counsel, agency advisor, prosecutor, public defender, transactional specialist, or litigator).
- Expertise in one or more recognized areas of current US or international legal practice (10+ years).
- Experience teaching or mentoring advanced legal concepts (3+ years), demonstrating an advanced ability to unpack and relay complex problems as logical, step-by-step thinking.
- Familiarity with AI tools (e.g., Claude code) and exceptional analytical abilities to identify trends, evaluate annotation quality, and provide actionable feedback.
- Minimum availability of ~20 hours/week (40 hours preferred); participation in 2–5 calibration calls per week.
Skills
- Strong written and verbal communication skills to effectively convey complex ideas.
- Proven ability to work collaboratively with cross-functional teams and external partners.
- Flexibility and willingness to learn and adapt to new technologies and processes.