Jobs · Engineering

Knowledge Expert Coder - Legal

Rose International · United States · 1 wk ago
RemoteRemoteEngineeringFull-time

Remote, USA • Temporary • Full-Time • 3-month engagement • $125.00/hour

About the role

We are seeking experienced legal professionals to provide subject-matter expertise ensuring quality standards for our AI training data. This remote role partners closely with AI research and engineering teams to advance cutting-edge technologies.

Responsibilities

  • Guide research teams to close knowledge gaps and improve AI model performance, focused on your specialty sub-domain area of practice.
  • Collaborate with other subject-matter experts to ensure consistency and accuracy in training data with respect to legal reasoning and content.
  • Create, edit, and maintain high-quality annotation guidelines tailored to your sub-domain area of practice, setting the gold standard for data quality and rigor.
  • Evaluate and grade the quality of annotations produced by vendors, identify areas of improvement, and provide feedback to optimize annotation quality.
  • Directly annotate data for key tasks across the model development life cycle.

Requirements

  • LL.B / J.D., LL.M, LL.D, or Ph.D in a law-related field; valid Bar licensure.
  • Minimum of 10+ years in the legal space (e.g., teaching law at a post-secondary institution, working at a law firm, in-house counsel, agency advisor, prosecutor, public defender, transactional specialist, or litigator).
  • Expertise in one or more recognized areas of current US or international legal practice (10+ years).
  • Experience teaching or mentoring advanced legal concepts (3+ years), demonstrating an advanced ability to unpack and relay complex problems as logical, step-by-step thinking.
  • Familiarity with AI tools (e.g., Claude code) and exceptional analytical abilities to identify trends, evaluate annotation quality, and provide actionable feedback.
  • Minimum availability of ~20 hours/week (40 hours preferred); participation in 2–5 calibration calls per week.

Skills

  • Strong written and verbal communication skills to effectively convey complex ideas.
  • Proven ability to work collaboratively with cross-functional teams and external partners.
  • Flexibility and willingness to learn and adapt to new technologies and processes.

Similar jobs