DevOps Engineer - Remote

AuraOne is a leading technology organization specializing in AI-driven solutions and cloud-based engineering services. Committed to innovation and excellence, the company provides cutting-edge tools and platforms that empower engineering teams worldwide. With a focus on quality, security, and scalability, the organization fosters a collaborative remote work environment that attracts top talent from across the United States. Their mission is to enhance software development processes through intelligent automation and rigorous quality assurance, ensuring their clients achieve optimal operational efficiency and security.

About the Role

This remote contractor position is dedicated to evaluating production code, debugging traces, and assessing developer-facing AI outputs against real-world correctness standards. The role involves reproducing failures, writing targeted unit tests, and providing detailed explanations to guide the modeling team in improving their outputs. The primary objective is to ensure that generated code is reliable, secure, and adheres to best practices by performing thorough code reviews and quality assessments. As part of a collaborative team, you will work closely with experienced engineers to maintain high standards of correctness, robustness, and security in AI-generated solutions. This position offers an exciting opportunity to influence the quality of engineering models, directly impacting the reliability of AI-driven code generation tools used across various applications.

Responsibilities

• Reproduce candidate code outputs in a sandbox environment for assessment.
• Grade cloud and platform engineering solutions for correctness, complexity, idiomatic style, and edge-case handling.
• Write minimal failing tests to demonstrate bugs missed by models.
• Compare paired solutions, providing ranked evaluations with rationale aligned to established rubrics.
• Identify and tag failure modes such as compile errors, runtime crashes, security issues, and off-by-one errors, assigning severity scores.
• Document recurring code-generation failures to facilitate targeted improvements by the modeling team.
• Calibrate reviews against gold-standard assessments to maintain high inter-rater agreement.
• Engage in continuous improvement of review processes and contribute to quality standards.

Qualifications

• Strong engineering experience with the ability to read, run, and debug unfamiliar codebases.
• Proficiency in writing concise and effective unit tests that capture specific failure modes.
• Experience with at least one testing framework such as pytest, Jest, JUnit, Go test, RSpec, or equivalent.
• Excellent written communication skills, capable of providing clear, convincing review notes.
• Reliable asynchronous availability for a minimum of 10 hours per week.
• Prior experience in code review or technical interview grading is a plus.
• Authorized to work in the United States.

Benefits

• Flexible remote work environment supporting work-life balance.
• Competitive hourly compensation, confirmed after the interview process.
• Opportunity to work with cutting-edge AI and cloud engineering technologies.
• Collaborative and innovative team culture focused on quality and security.
• Professional development opportunities through exposure to diverse engineering challenges.