Legal AI Evaluation Expert
Weekday AI (YC W21) · United States · 1 wk ago
RemoteRemoteOTHR$100–$150/hrPart-time
Key Responsibilities
- Evaluate AI-Generated Legal Content
- Review and compare AI-generated responses to legal scenarios involving workplace and employment-related matters
- Assess responses for legal accuracy, completeness, logical reasoning, and client readiness
- Verify that outputs align with established U.S. employment and labor law principles
- Provide Expert Feedback
- Deliver structured written evaluations identifying strengths, weaknesses, and opportunities for improvement
- Highlight factual inaccuracies, legal reasoning gaps, and inconsistencies
- Apply standardized evaluation criteria to ensure objective and consistent assessments
- Support AI Model Improvement
- Participate in onboarding sessions and calibration activities
- Collaborate with project teams by providing domain-specific insights that enhance model performance
- Maintain consistency and quality across evaluation tasks
Required Qualifications
- Minimum of 2 years of professional experience practicing Employment or Labor Law
- Experience gained in a law firm, corporate legal department, government agency, labor organization, or similar legal environment
- Juris Doctor (J.D.) from an accredited U.S. law school or an LL.B./LL.M. from an accredited institution
- Licensed to practice law in the United States (active or inactive license accepted)
- Strong expertise in legal research, legal writing, case law analysis, and drafting legal memoranda
- Excellent written communication skills with exceptional attention to detail
- Solid understanding of the U.S. legal system and employment law practices
Role Highlights
- Flexible workload of approximately 6-15 hours per week
- Fully remote with the ability to work on your own schedule
- Immediate project availability with applications reviewed on a rolling basis
- Competitive compensation ranging from $100-$150 per hour, depending on qualifications and experience
- Help improve the legal reasoning capabilities of advanced AI technologies
- Work on intellectually engaging legal evaluation assignments with flexible scheduling
- Contribute to the development of AI systems capable of delivering more accurate and reliable legal analysis
Equal Opportunity Statement
We are committed to providing equal opportunities to all qualified applicants without regard to legally protected characteristics.