Korean Voice AI Evaluator – Native Speakers Wanted
Alignerr · New York, NY · 1 wk ago
RemoteRemoteEducationContract
Korean Voice AI Evaluator (Healthcare Front Desk Conversations) About The Role What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Korean speakers based in the United States to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action. With one of the largest Korean-speaking diaspora communities in the world, the US is home to a wealth of native-fluency talent perfectly suited to this role. You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance — all from home, on your own schedule. Organization: AlignerrType: Contract (task-based)Location: RemoteCommitment: Flexible, work at your own pace What You'll Do Hold 4 to 5 minute spoken conversations in Korean with an AI front desk assistant, playing a fictional patientSay natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or checking insuranceReview transcripts and classify how accurately the AI understood you and respondedFlag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestampsTest how the AI handles background noise, short replies ("네," "아니요," "괜찮아요"), long numbers, emotional moments, and sensitive or unsafe requestsFollow detailed labeling guidelines consistently and submit high-quality work Who You Are Native or near-native Korean speaker with a clear, natural speaking voiceDetail-oriented, with the patience to review recordings and transcripts closelyComfortable role-playing a patient and sounding authenticAble to follow multi-step instructions and apply them consistentlyReliable and self-directed when working independentlyAccess to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noiseComfortable using web-based tools Nice to Have Experience in voice AI evaluation, data annotation, or QA testingBackground in healthcare administration, customer service, or call center workStrong sense of Korean speech levels and politeness (존댓말) in service conversations, and of how Korean numbers are read aloud (native vs. Sino-Korean)Linguistics or language-focused studiesFamiliarity with medical terminology in Korean Why Join Us Work on cutting-edge AI projects alongside leading research labsFully remote and flexible — work when and where it suits youTask-based work with real autonomyDirectly help make voice AI more accurate, natural, and safe in healthcare settingsPotential for ongoing work as new projects launch Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.