Software Engineer — AI Code Ranking

About The Role

What if your years of software engineering experience could directly shape how AI writes code for millions of developers? We're looking for Software Engineers in New York to evaluate, rank, and refine AI-generated code — helping the next generation of coding assistants produce solutions that are correct, efficient, idiomatic, and production-ready. Your deep understanding of software architecture, design patterns, and real-world engineering trade-offs is exactly what AI models need to get better. This isn't about writing boilerplate — it's about applying expert judgment to push the boundaries of what AI can do with code.

This is a fully remote, flexible contract role built for experienced developers who want meaningful, high-impact work on their own schedule.

Type

Hourly Contract

Organization

Alignerr

Location

Remote

Commitment

10–40 hours/week

What You'll Do

• Review and rank AI-generated code solutions across multiple programming languages and problem domains
• Evaluate code for correctness, efficiency, readability, maintainability, and adherence to best practices
• Identify bugs, anti-patterns, security issues, and performance bottlenecks in AI-generated outputs
• Write detailed, structured feedback explaining why one solution is better than another
• Refined and improve AI-generated code to meet production-level engineering standards
• Provide preference rankings that help AI models learn what "good code" actually looks like
• Work independently and asynchronously — fully on your own schedule

Who You Are

• Software engineer with 3+ years of professional development experience
• Proficient in one or more major programming languages (e.g., Python, JavaScript/TypeScript, Java, C++, Go, Rust)
• Strong grasp of data structures, algorithms, and computational complexity
• Deep understanding of software design principles, clean code practices, and engineering trade-offs
• Experienced with code review — you know how to assess quality and articulate why something works or doesn't
• Clear, concise written communicator who can explain technical decisions effectively
• Self-motivated and reliable when working independently without supervision

Nice to Have

• Experience across multiple languages, frameworks, or tech stacks
• Background in systems design, distributed systems, or backend architecture
• Familiarity with AI/ML concepts or experience using AI coding tools (Copilot, ChatGPT, etc.)
• Prior experience with code evaluation, technical mentoring, or open-source contribution
• Knowledge of security best practices and performance optimization
• Experience in competitive programming or technical interviewing