Machine Learning & NLP Expert

Accountabilities

• Support advanced AI development initiatives by applying deep technical expertise in machine learning, natural language processing, and model evaluation.
• Create high-quality datasets, design challenging benchmarks, and provide insights that improve AI system capabilities.
• Develop accurate reference solutions and integrate tasks into agent-based development environments using Python.
• Build executable evaluation frameworks, test components, and benchmark approaches where applicable.
• Analyze AI model outputs to assess technical accuracy, reasoning quality, and overall effectiveness.
• Identify model limitations, classify failure patterns, and provide detailed written feedback to support improvement efforts.
• Create and refine evaluation guidelines, scoring methodologies, and quality standards for AI training and assessment.
• Collaborate with other technical experts to ensure consistency, accuracy, and reliability across AI evaluation projects.
• Apply knowledge of modern AI architectures and workflows to improve model training and performance evaluation processes.

Requirements

• Experienced machine learning or NLP professional with strong technical capabilities, practical coding experience, and the ability to independently solve complex AI challenges.
• Strong understanding of modern AI methods and comfortable working in a remote, research-driven environment.
• Deep hands-on experience in machine learning and/or natural language processing through industry experience, academic research, or graduate-level work.
• Strong proficiency in Python with experience developing machine learning or NLP applications.
• Strong understanding of modern machine learning concepts, including: Model training and evaluation, Transformer architectures, Large language models (LLMs), NLP pipelines, Feature engineering and model optimization.
• Experience working with frameworks such as PyTorch, TensorFlow, Hugging Face Transformers, or equivalent technologies.
• Able to dedicate approximately 20 hours per week to the engagement.
• Strong written communication skills with the ability to clearly document technical findings and evaluations.
• Able to work independently, manage priorities, and deliver high-quality results in a remote environment.

Preferred Qualifications

• Experience with AI model evaluation, training data creation, or human-in-the-loop AI assessment.
• Familiarity with retrieval-augmented generation (RAG), vector databases, embedding models, or multimodal AI systems.
• Experience building benchmarking frameworks, automated evaluation pipelines, or testing infrastructure.
• Contributions to open-source machine learning or NLP projects, academic publications, or research initiatives.
• Experience deploying or maintaining production-scale machine learning systems.

Benefits

• Competitive compensation of $80-$110 per hour based on experience and qualifications.
• Fully remote work arrangement with flexible scheduling.
• Part-time engagement requiring approximately 20 hours per week.
• Opportunity to contribute to cutting-edge AI research and model development initiatives.
• Collaboration with experienced machine learning and NLP specialists.
• Potential for project extensions based on business needs and performance.
• Weekly payments through Stripe or Wise for completed services.
• Independent contractor flexibility with the ability to manage your own working schedule.