DirectJobHub
Jobs · Engineering

Python - Senior Developers - AI Training

Prolific · New York, NY · 2 mo ago
RemoteRemoteEngineering$50/hrTemporary

About the role

We’re looking for Senior Python Developers to join our Expert Network to help train and evaluate cutting-edge AI models. If you have a background in Software Engineering, we’ll send you a quick 10- to 15-minute test to assess your skills. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to help AI understand and summarize complex scientific data.

Responsibilities

  • Evaluate Code Accuracy: review AI-generated Python code for functional correctness and adherence to best practices.
  • Validate Logic & Reasoning: audit the step-by-step explanations provided by AI for complex algorithmic solutions to ensure they are logically sound.
  • Conduct Execution Testing: execute model-generated scripts in appropriate environments to verify performance and output.
  • Annotate Model Performance: identify areas where a model provides inefficient solutions, deprecated syntax, or hallucinated library methods.
  • Refine Technical Logic: provide structured feedback on how models reason through backend architecture, data pipelines, or API design discussions.

Requirements

  • Educational Background: a BSc or higher in Computer Science, Software Engineering, or closely related technical field
  • Professional Experience: real world experience as a Senior Software Engineer/ Developer specializing in Python
  • Coding Proficiency: ability to solve LeetCode Medium to Hard-level problems in Python independently.
  • Deep Domain Knowledge: expert understanding of the GIL (Global Interpreter Lock), decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
  • Code Quality: a high standard for clean code, including modularity, readability, and adherence to modern Pythonic standards (PEP 8, PEP 20).
  • Attention to Detail: ability to spot subtle logical flaws, memory leaks, or security vulnerabilities in model-generated code.

Qualifications

  • Core Language: expert mastery of Python 3.x, including type hints and modern language features.
  • Frameworks: extensive experience with Django, FastAPI, or Flask.
  • Testing & Tools: proficiency with pytest, unittest, coverage.py, and tox.
  • Backend & API: strong understanding of RESTful APIs, GraphQL, and server-side logic in a Python environment (e.g., with FastAPI or Django REST Framework).

Skills

  • Expertise in Python programming
  • Experience with web frameworks like Django, FastAPI, or Flask
  • Knowledge of testing tools such as pytest, unittest, coverage.py, and tox
  • Understanding of RESTful APIs, GraphQL, and server-side logic in a Python environment

Benefits

  • Competitive pay rates
  • Flexible working hours
  • The ability to work from home

Pay

Researchers looking for your skills tend to pay up to $50/hr, depending on skills and experience level.

Schedule

One hour of uninterrupted work per task, though many are shorter.

Links to more information on Prolific

Links to more information on Prolific

Privacy Statement

By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.

Create a Job Alert

Interested in building your career at Prolific Academic Ltd? Get future opportunities sent straight to your email.

Apply for this job

* indicates a required field

Similar jobs