Software Engineering Expert – AI Evaluation

About the role

We are seeking experienced Software Engineering Experts to support the development of next-generation AI systems by evaluating AI-generated technical deliverables. In this role, you will apply your software engineering expertise to assess the quality, accuracy, and practical value of AI-generated documents, presentations, spreadsheets, and technical analyses. This is an excellent opportunity for senior software professionals who enjoy technical review, structured evaluation, and helping improve AI systems used in engineering workflows.

Responsibilities

• Review and evaluate AI-generated software engineering deliverables for technical accuracy and real-world applicability.
• Assess technical documentation, engineering reports, presentations, and analytical artifacts using structured evaluation criteria.
• Identify factual inaccuracies, logical inconsistencies, architectural issues, and presentation deficiencies.
• Evaluate the clarity, completeness, and usability of engineering recommendations and technical content.
• Provide detailed, structured written feedback to improve AI-generated outputs.
• Apply standardized quality rubrics to ensure objective and consistent evaluations.
• Collaborate with multidisciplinary teams supporting AI model development and benchmarking.
• Contribute domain expertise to improve AI performance across software engineering use cases.

Requirements

• 5+ years of professional Software Engineering experience at a leading technology company or engineering organization in the United States, United Kingdom, Canada, Australia, or New Zealand.
• Native or professional-level proficiency in English.
• Strong understanding of software development principles, system design, and engineering best practices.
• Advanced proficiency with Microsoft Office (PowerPoint, Excel, Word) and Google Workspace.
• Excellent analytical thinking, technical communication, and problem-solving skills.
• Ability to critically evaluate complex technical content with exceptional attention to detail.

Qualifications

• Master's degree (or higher) in Computer Science, Software Engineering, or a related discipline.
• Experience in software architecture, distributed systems, cloud computing, or large-scale application development.
• Previous experience performing technical reviews, code reviews, architecture assessments, or engineering documentation.
• Familiarity with AI technologies, software evaluation methodologies, or quality assurance processes.
• Experience creating technical standards, engineering guidelines, or evaluation frameworks.

Skills

• Software development principles, system design, engineering best practices.
• Proficiency with Microsoft Office and Google Workspace.
• Analytical thinking, technical communication, problem-solving.
• Critical evaluation of complex technical content with attention to detail.

Pay

Competitive hourly compensation of $100–$150, based on experience. Weekly payments via Stripe or Wise.

Schedule

Fully remote independent contractor engagement with flexible working schedule.

Benefits

• Opportunity to contribute to cutting-edge AI research and software engineering evaluation projects.
• High-performing contributors may receive invitations to future AI engineering initiatives.