DevOps Engineer (Full Time - Remote)

About the role

Hiring experienced DevOps engineers to author and validate Infrastructure-as-Code (IaC) tasks. Design realistic infrastructure scenarios, build ground-truth solutions, and define automated checks for AI agent evaluation.

Responsibilities

• Author IaC tasks grounded in real-world AWS and GCP scenarios
• Build correct, idempotent IaC solutions for each task
• Design verifiable automated graders that confirm AI agent reaches correct end state
• Review and QA tasks authored by other engineers (correctness, difficulty, robustness)
• Harden tasks against reward hacking
• Document task intent, assumptions, edge cases, and scoring rationale

Requirements

• 4+ years in DevOps / cloud engineering
• Deep, hands-on Infrastructure-as-Code expertise: Terraform (required); Pulumi, CloudFormation, or CDK a plus
• Strong AWS and GCP depth
• Comfortable scripting in Python and/or Bash for automation and validation
• Clear sense of correctness and verification (articulate in code what makes an infrastructure outcome right and safe)

Qualifications

• Prior work in AI evaluation, benchmarking, or expert data annotation (preferred)
• Prior experience with LocalStack (preferred)