Competitive Data Scientist – AI Model Evaluation

About the Opportunity

We are hiring experienced Data Scientists, Machine Learning Practitioners, and Applied Mathematics Experts with a strong background in competitive data science and machine learning competitions.

This opportunity is ideal for professionals who enjoy solving challenging technical problems, developing robust analytical solutions, and testing the limits of AI-powered coding systems.

You will use your expertise in mathematics, programming, statistical modeling, and machine learning to develop challenging data science tasks that require genuine technical reasoning rather than superficial or plausible answers.

Your work will help evaluate and improve advanced AI systems by creating reproducible testing environments, verified reference solutions, and reliable evaluation methods.

Responsibilities

• Develop Reproducible Environments: Set up testing environments, prepare datasets, configure dependencies, and implement reliable reference solutions.
• Design Evaluation Frameworks: Create comprehensive tests and assessment criteria that distinguish correct, complete solutions from flawed or incomplete approaches.
• Evaluate AI Coding Systems: Run AI coding agents against challenging data science tasks, analyze their performance, and investigate errors or unexpected outcomes.
• Improve Task Quality: Refine tasks based on observed AI behavior to ensure they accurately assess technical reasoning and problem-solving capabilities.
• Identify Technical Issues: Detect implementation errors, incorrect assumptions, data leakage, and other problems that may compromise solution validity.
• Document Solutions: Prepare clear technical documentation covering task requirements, solution methodologies, reasoning, and verification procedures.
• Validate Results: Ensure that reference implementations and evaluation procedures produce consistent, reproducible outcomes.

Required Qualifications

Professional & Competition Experience

• Demonstrated experience in Data Science, Machine Learning Engineering, Quantitative Modeling, Applied Mathematics, or a related technical discipline.
• Experience participating in competitive data science or machine learning challenges, such as Kaggle or DrivenData.
• Strong analytical thinking and the ability to solve complex technical problems independently.
• A solid understanding of the mathematical and computational methods used in your solutions.

Technical Expertise

• Strong programming skills, particularly in Python.
• Practical experience developing, testing, debugging, and validating code.
• Knowledge of machine learning algorithms, statistical modeling, and data analysis.
• Ability to implement and verify reference solutions independently.
• Experience working with datasets, software dependencies, and reproducible computational environments.
• Ability to understand unfamiliar codebases and troubleshoot complex technical issues.

Preferred Qualifications

• Strong Python development skills, including testing, debugging, and code optimization.
• Experience building automated evaluation pipelines and validation frameworks.
• Familiarity with AI coding agents and automated software evaluation.
• Experience identifying data leakage, model validation issues, and methodological weaknesses.
• Background in competitive programming, mathematical optimization, or quantitative research.
• Ability to communicate complex technical concepts through clear documentation.

Benefits

• Competitive Compensation: Earn $60–$120 per hour based on the engagement terms.
• Global Remote Opportunity: Work from anywhere, subject to project eligibility and requirements.
• Flexible Schedule: Choose the hours and days that work best for you.
• Advanced AI Projects: Contribute to the evaluation and improvement of next-generation AI systems.
• Technical Challenges: Apply your expertise to problems that demand rigorous reasoning, coding, and mathematical insight.
• Independent Working Environment: Focus on delivering high-quality technical work with clearly defined objectives.

Pay

$60–$120 per hour (independent contractor engagement).

Schedule

Approximately 15 hours per week; flexible – choose your working hours and days, including weekends.