Jobs · OTHR

Legal AI Evaluation Expert

Weekday AI (YC W21) · United States · 1 wk ago
RemoteRemoteOTHR$100–$150/hrPart-time

Key Responsibilities

  • Evaluate AI-Generated Legal Content
  • Review and compare AI-generated responses to legal scenarios involving workplace and employment-related matters
  • Assess responses for legal accuracy, completeness, logical reasoning, and client readiness
  • Verify that outputs align with established U.S. employment and labor law principles
  • Provide Expert Feedback
  • Deliver structured written evaluations identifying strengths, weaknesses, and opportunities for improvement
  • Highlight factual inaccuracies, legal reasoning gaps, and inconsistencies
  • Apply standardized evaluation criteria to ensure objective and consistent assessments
  • Support AI Model Improvement
  • Participate in onboarding sessions and calibration activities
  • Collaborate with project teams by providing domain-specific insights that enhance model performance
  • Maintain consistency and quality across evaluation tasks

Required Qualifications

  • Minimum of 2 years of professional experience practicing Employment or Labor Law
  • Experience gained in a law firm, corporate legal department, government agency, labor organization, or similar legal environment
  • Juris Doctor (J.D.) from an accredited U.S. law school or an LL.B./LL.M. from an accredited institution
  • Licensed to practice law in the United States (active or inactive license accepted)
  • Strong expertise in legal research, legal writing, case law analysis, and drafting legal memoranda
  • Excellent written communication skills with exceptional attention to detail
  • Solid understanding of the U.S. legal system and employment law practices

Role Highlights

  • Flexible workload of approximately 6-15 hours per week
  • Fully remote with the ability to work on your own schedule
  • Immediate project availability with applications reviewed on a rolling basis
  • Competitive compensation ranging from $100-$150 per hour, depending on qualifications and experience
  • Help improve the legal reasoning capabilities of advanced AI technologies
  • Work on intellectually engaging legal evaluation assignments with flexible scheduling
  • Contribute to the development of AI systems capable of delivering more accurate and reliable legal analysis

Equal Opportunity Statement

We are committed to providing equal opportunities to all qualified applicants without regard to legally protected characteristics.

Similar jobs

Legal Expert - AI Trainer

DataAnnotationMassachusetts, United States· 4 wk ago
RemoteEducationapply on app.dataannotation.tech