Senior AI Software Engineer (Remote)

About the role

We are seeking a Senior Software Engineer – LLM Evaluation to work on a full-time basis. You will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in multiple programming languages.

Responsibilities

• Curate code examples, build solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
• Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions against industry performance benchmarks.
• Build agents that verify code quality and identify error patterns.
• Hypothesize on software engineering cycle steps and evaluate model capabilities on them.

Requirements

• Several years of software engineering experience, including 2+ years at a top-tier product company.
• Strong expertise in building full-stack applications.
• Experience with Python and JavaScript, including ReactJS.
• Proficiency in C/C++, Java, Rust, and Go.
• Ability to design verification mechanisms for software engineering tasks.

About the opportunity

This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement of AI systems that drive measurable business impact.