Senior Data Science Expert – AI Evaluation Specialist

About the role

Join a groundbreaking AI evaluation initiative in collaboration with a leading AI research organization. We are seeking experienced Data Science Experts to help evaluate and improve the performance of next-generation AI systems on real-world data science tasks. This opportunity is ideal for senior data professionals who possess strong analytical judgment and a deep understanding of modern data science practices. Rather than building models or delivering business analyses, you will assess the quality of completed work, define evaluation standards, and provide expert feedback that helps advance AI capabilities.

Responsibilities

• Design clear, objective, and task-specific evaluation frameworks for real-world data science outputs.
• Review and assess data science deliverables, including:
• Data analyses
• Predictive models
• Business intelligence dashboards
• Experiment reports
• Strategic recommendations
• Evaluate AI-generated and human-produced work against defined quality standards.
• Provide detailed written reasoning and evidence-based justifications for assessment scores.
• Ensure consistency, fairness, and reproducibility across all evaluations.
• Collaborate with senior reviewers and project stakeholders to refine evaluation methodologies.
• Incorporate feedback efficiently and maintain high-quality assessment standards.

Requirements

• Professional Experience:
  • 5+ years of hands-on industry experience in Data Science, Analytics, Machine Learning, or a related field.
  • Demonstrated success applying data-driven insights to solve complex business challenges.
• Technical Expertise:
  • Strong knowledge of:
  • Statistical analysis
  • Experiment design and A/B testing
  • Metric development and KPI frameworks
  • Predictive modeling
  • Data visualization and reporting tools
  • Advanced proficiency in:
  • SQL
  • Python
  • Ability to critically evaluate analytical methodologies and recommendations.

  Qualifications

  • Industry Background:
    • Experience in Product Analytics, Growth Analytics, Business Operations, or Strategic Data Science functions.
    • Background working within technology-driven organizations, high-growth companies, or enterprise analytics environments is highly preferred.
  • Communication & Evaluation Skills:
    • Exceptional written communication and documentation skills.
    • Ability to provide structured, objective, and defensible evaluations.
    • Strong attention to detail and commitment to analytical rigor.
    • Comfortable participating in peer-review and calibration processes.

  Preferred Qualifications

  • Experience with AI model training, evaluation, reinforcement learning, or human feedback projects.
  • Previous involvement in technical review, research evaluation, or data science mentoring.
  • Familiarity with AI-assisted analytics platforms and emerging data science technologies.
  • Experience creating assessment frameworks or quality assurance processes for analytical work.

  Why Join?

  • Contribute directly to the development of advanced AI systems.
  • Apply your expertise to evaluate high-impact data science work.
  • Flexible, fully remote engagement.
  • Competitive compensation for experienced professionals.
  • Collaborate with leading experts in AI, machine learning, and analytics.

  Application Process

  • Submit your resume or relevant professional background.
  • Shortlisted candidates may be invited to complete a brief technical assessment or provide additional information.

  Contract & Payment Details

  • Independent contractor engagement.
  • Fully remote with flexible working hours.
  • Project duration may vary based on business needs and performance.
  • No access to confidential or proprietary employer information is required.
  • Weekly payments via Stripe or Wise.
  • H1-B and STEM OPT sponsorship are not available for this opportunity.