Data Science & Quantitative Analysis Expert

Key Responsibilities

• Design realistic data analysis challenges inspired by real-world research and analytical workflows, including data preparation, statistical modeling, hypothesis testing, and comparative analysis
• Create reproducible reference analyses using Jupyter Notebooks or Google Colab, documenting methodologies and findings with clarity
• Create benchmark tasks that require objective comparisons between analytical techniques, supported by statistical validation and evidence-based recommendations
• Evaluate AI-generated analyses for correctness, statistical validity, reasoning quality, and interpretation accuracy
• Identify analytical errors, flawed assumptions, and reasoning gaps that experienced data professionals would immediately recognize
• Collaborate with AI researchers and fellow subject matter experts to improve benchmark quality, consistency, and analytical rigor

Required Qualifications

• Master's degree, PhD, or equivalent practical experience in Data Science, Statistics, Mathematics, Economics, Operations Research, or another quantitative STEM discipline
• Minimum 1 year of professional experience in research, research engineering, quantitative analysis, data science, or another data-intensive analytical role
• Strong hands-on experience with data cleaning, exploratory data analysis, statistical testing, correlation analysis, predictive modeling, and interpretation of analytical results
• Proficiency with Jupyter Notebooks or Google Colab for building reproducible analytical workflows
• Strong programming skills in Python, including experience with libraries such as pandas, NumPy, SciPy, scikit-learn, or similar analytical frameworks
• Working knowledge of Git and collaborative software development practices
• Excellent written communication skills with the ability to present analytical findings clearly to both technical and non-technical audiences
• Experience with AI evaluation, benchmark development, AI model assessment, or task authoring is preferred
• Exceptional analytical thinking, creativity, attention to detail, and the ability to solve complex, open-ended problems independently
• Able to commit approximately 35 hours per week on a consistent basis

PREFERRED QUALIFICATIONS

• Experience designing reproducible research workflows or analytical evaluation frameworks
• Familiarity with machine learning, large language models, or AI-assisted data analysis
• Background in benchmark design, statistical modeling, or quantitative research methodology
• Experience reviewing analytical work, mentoring analysts, or contributing to research publications

Benefits

Help shape the future of AI by improving how advanced models are evaluated on real-world analytical reasoning
Collaborate with leading AI researchers developing frontier evaluation benchmarks
Contribute directly to benchmark development that influences the evolution of next-generation AI systems
Enjoy the flexibility of a fully remote engagement while working on impactful AI research initiatives

Pay

$60-$90 per hour

Schedule

Full-time engagement requiring approximately 35 hours per week

Contract & Engagement Details

• Independent contractor engagement
• Full remote with flexible working hours
• Expected commitment of approximately 35 hours per week
• Project duration may be extended, shortened, or concluded based on project requirements and individual performance
• Work does not require access to confidential or proprietary information from any current or former employer
• Payments are issued weekly based on approved work completed