Jobs · Engineering

Senior Software Engineer (Agentic Coding RL Environments)

DataAnnotation · Austin, TX · Yesterday
RemoteRemoteEngineering$100–$150/hrFull-time

Responsibilities

  • Build coding RL environments and benchmarks that test how agents perform on realistic software engineering tasks
  • Design tasks based on real engineering work
  • Review and red-team model output to surface meaningful failures
  • Write the tests, rubrics, and success criteria that separate good work from slop
  • Give structured feedback that improves future models

Qualifications (Must-Have)

  • Professional software engineering experience shipping real, scaled production systems
  • Expertise in at least one common tech stack (TypeScript, Python, Ruby, PHP, Java, Rust, Go, or C++)
  • Strong judgment about what "good code" and a "meaningful model failure" look like
  • Comfort working independently, and giving direct, code-review-style feedback
  • Availability for a meaningful commitment (most contributors work 20 to 40+ hours per week)

Note

You do not need prior AI or ML experience. Strong engineering judgment and attention to detail matter most.

What Makes This Different

  • No managers, 1:1s, OKR ceremonies, or Jira backlog grooming
  • You choose when and where you work
  • You are judged on the quality of what you produce, not speed

Application Process

  • Coding capability screen (replaces a multi-round interview loop)
  • ID verification
  • Background check
  • Paid first real task. Do well, and you're on the team.

Contact

Questions?: Email swe@surgehq.ai

Similar jobs

Senior Software Engineer

HaystackSan Diego Metropolitan Area· 1 wk ago
Information Technology$178k–$268k/yrapply on haystack.cv

Senior Software Engineer

The Amatriot GroupSterling, VA· 4 wk ago
Information Technology$185k–$225k/yrapply on amatriot.clearcompany.com

Senior Software Engineer

SymboticAustin, TX· 1 mo ago
Engineering$149k–$205k/yrapply on symbotic.wd504.myworkdayjobs.com