Data Scientist - Python (Remote)

About the role

We are hiring a Data Scientist/Analyst to develop and maintain high-quality Python code for training and optimizing AI models. The role involves conducting evaluations to benchmark performance, analyzing results, and collaborating with researchers and annotators to execute reinforcement learning with human feedback and refine reward models.

Responsibilities

• Design, develop, and maintain efficient, high-quality code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and analyze results for continuous improvement.
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
• Lead efforts in supervised fine-tuning, including creating and maintaining high-quality, task-specific datasets.

Requirements

• Proficiency in Python for data analysis and model development.
• Experience with data science and machine learning techniques.
• Ability to use business sense and analytical abilities to extract insights from public databases.
• Strong skills in bug fixing and creating thorough technical documentation.
• Excellent communication skills to clearly articulate reasoning and logic in Jupyter notebooks or similar formats.

About the opportunity

This role offers a unique opportunity to work with a global leader in the Technology, Information, and Internet industry, contributing to the advancement of cutting-edge AI systems. The position involves solving mission-critical priorities for companies through real-world AI applications.