Human-Evaluation Specialist

About the role

Human-Evaluation Specialists oversee human-in-the-loop evaluations and annotation tasks.

Responsibilities

• Design evaluation protocols: Define evaluation tasks, criteria, and scoring guidelines.
• Review AI outputs: Assess AI-generated outputs for quality, usability, and correctness.
• Identify inconsistencies: Detect errors, hallucinations, and ambiguous results.
• Provide structured feedback: Document issues and provide feedback to developers for model improvements.
• Contribute to workflow improvements: Suggest improvements to evaluation workflows and training data collection.

Requirements

• Bachelor's degree in human-computer interaction or a related field.
• Experience in annotation tasks and quality assurance processes.

Engagement pathways

TAIRC is currently building its funding base. Opportunities identified as volunteer or unpaid do not provide compensation at this stage. Any future paid appointment would require available funding, organizational approval, applicable legal compliance, and a separate written agreement. Participation does not guarantee future employment or compensation.

• Volunteer contribution interest may be reviewed only as a voluntary, scoped pathway.
• Educational internship interest requires separate supervision, educational purpose, and legal review.
• Advisory expressions of interest are not board or formal advisory appointments.
• Future compensated employment is contingent on funding, approval, legal compliance, and a separate written offer.

For an accommodation or alternate submission format, contact hr@tairc.com. The application form does not request medical documentation or sensitive identity documents.