AI Quality Analyst

Description

We run an AI-powered SMS bot and an AI-graded call training system for a private school network. Both systems have extensive test suites (400+ test files) and a RAG-based knowledge base that drives bot behavior.

Requirements

• Native-level English fluency (non-negotiable).
• You'll be writing realistic SMS conversations between parents and our school. The language has to sound like a real person texting, not a corporate chatbot.
• You'll also be writing precise pass/fail evaluation criteria.
• Comfortable editing JSON and Markdown in an IDE.
• Can run commands in a terminal without hand-holding.
• Extreme attention to detail.
• Able to learn a complex domain quickly (education, state government programs, etc).

Hours & Ramp-Up

• 30 hrs/week to start, ramping up as needed.
• US time zones required.
• The first 1-2 weeks will be focused on learning our domain — how our school works, how the state voucher program works, compliance rules, etc.
• We have extensive internal documentation.