AI Speech Evaluator

About the role

This role supports LLM evaluations and engineering tasks, including data annotation and validation, rating LLM prompts, and conducting on-device testing. It is a vendor position with Highspring for a client at a Fortune 100 company.

Responsibilities

• Data annotation and validation
• Rating LLM prompts
• Conducting on-device testing

Requirements

• Fully fluent, written and verbal, in English
• Excellent written and verbal communication skills
• Familiarity with current AI chatbots
• Undergraduate degree
• Strong analytical skills
• 1-2 years work experience
• Proficient in Google Docs and Sheets

Preferred Qualifications

• Fluent (verbal and written) in any additional language than English
• Experience working on LLM data annotations
• Other testing, QA experience

Schedule

Monday to Friday, standard business hours (flexible schedule within business hours). Onsite presence in San Jose is required for training during the first week of onboarding and regularly after that (once to twice a month minimum).

Benefits

Full Time (40 hrs/week), sick time off, parenting leave, health benefits with low premiums, and access to a comprehensive well-being program with resources to support physical and mental health: Employee Assistance Program, Live and recorded meditation, Yoga, Webinars, Events, Resilience skill building, and more.