Data Science Expert
Weekday AI (YC W21) · United States · 1 wk ago
RemoteRemoteOTHR$120–$170/hrPart-time
About the role
This role is for one of our clients.
Compensation
$120-$170 per hour
Join a leading AI research organization
working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks.
Key Responsibilities
- Design detailed, task-specific evaluation criteria for real-world data science deliverables, including:
- Data analyses
- Predictive and statistical models
- Dashboards and visualizations
- Experiment results
- Executive recommendations and business insights
- Evaluate AI-generated and human-produced work using objective scoring frameworks.
- Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
- Apply sound analytical judgment to produce reproducible and defensible assessments.
- Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
- Collaborate with cross-functional teams to improve AI training quality and evaluation standards.
Required Qualifications
- 5+ years of professional experience in Data Science within an industry environment.
- Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
- Deep expertise in:
- Experimental design and A/B testing
- Statistical analysis
- SQL and Python
- Metric development and performance measurement
- Translating analytical findings into business recommendations
- Excellent written communication skills with the ability to clearly explain technical reasoning.
- Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
- Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.
Preferred Qualifications
- Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
- Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
- Experience reviewing technical work or mentoring analytical teams is a plus.