Linguist

About the role

The linguist will assist stakeholders in bringing rigor to human evaluations, guiding human evaluation workflows from ideation to pilot to production launch. Working cross-functionally with other specialists, they will use analysis and linguistic principles to create process manuals, suggest process improvements, and provide insights into human evaluation performance. The linguist will be responsible for designing evaluation processes, as well as the measurements for success and failure of those evaluations. They will also conduct training across suppliers and run calibration sessions with Product and Vendor teams. This is a vendor role with Highspring for a client's team, a Fortune 100 company. This position is currently remote in the United States (Preferred Bay Area-based) until further notice.

Responsibilities

• Design evaluation processes and success/failure measurements for human evaluations
• Create process manuals and suggest process improvements
• Provide insights into human evaluation performance
• Conduct training across suppliers
• Run calibration sessions with Product and Vendor teams
• Guide human evaluation workflows from ideation to pilot to production launch

Minimum Qualifications

• Native or professional fluency in English
• Bachelor's or Master's degree in Linguistics, Computational Linguistics, or a related field
• 1–2 years of experience in a related field
• Experience with project management responsibilities
• Experience with machine learning, LLMs, prompt engineering, or natural language processing
• Strong understanding of core linguistic concepts, including phonetics, phonology, morphology, syntax, and semantics
• Excellent communication skills (both written and oral), and ability to explain complex/technical concepts to a wider audience

Preferred Qualifications

• Professional experience in the role of a project manager or similar
• Proven experience in linguistic data annotation, transcription, or analysis
• Experience working on large-scale data projects in a technology or AI company
• Experience writing process guides
• Knowledge of SQL or Python

Schedule

Weekday, fixed schedule in PST timezone (7:30am to 5pm range).

Pay

$70,000 – $75,000 annual salary. The individual may also be eligible for discretionary bonuses.