Machine Learning Evaluation Specialist

About The Role

What if your years of hard-earned research expertise could directly shape the future of AI? We're looking for domain experts with deep machine learning knowledge to design evaluation challenges that push state-of-the-art AI systems to their limits. This isn't reviewing chatbot responses or rating simple outputs. You'll be crafting complex, nuanced problems that only a true domain expert could construct — and that only the most capable AI systems could hope to solve.

Organization

Alignerr
Type: Hourly Contract
Location: Remote
Commitment: 10–40 hours/week

Who You Are

• You hold a graduate-level degree (MS or PhD preferred) in a scientific or technical field that intersects with machine learning
• You have strong working knowledge of ML methods — model selection, feature engineering, evaluation metrics, and pipeline design
• You're deeply familiar with active, open research problems in your field
• You can identify precisely where general ML knowledge breaks down and specialized domain insight becomes essential
• You have experience conducting or publishing original research (highly valued)
• You communicate complex ideas clearly and precisely in writing
• You're self-motivated and thrive working independently on intellectually demanding tasks

Example Domains (Not Exhaustive)

• Computational biology, genomics, or bioinformatics
• Climate science and environmental modeling
• Medical imaging and healthcare
• Materials science and computational chemistry
• Astro physics and signal processing
• Natural language processing for low-resource or specialized corpora
• Robotics, control theory, or reinforcement learning in complex environments
• Financial modeling and quantitative analysis