Jobs · Consulting

AI Harness Engineer

Armis · New York City Metropolitan Area · 1 mo ago
RemoteRemoteConsultingFull-time

About the role

We're building the next generation of secure AI infrastructure. Our team is creating the foundational technologies that allow AI agents to operate safely, securely, and reliably at scale. This includes building secure agent control planes, embedded controls, developer tooling, observability, and infrastructure that enables production-ready AI systems. This is a hands-on engineering role for someone who enjoys building products from the ground up. You'll partner closely with AI researchers and backend engineers to rapidly move ideas into production while helping establish engineering best practices across our AI Center of Excellence.

Responsibilities

  • Design and build secure AI infrastructure for production AI agents.
  • Develop Agent Control Plane capabilities that manage, monitor, and secure agent execution.
  • Build embedded controls and security mechanisms directly into AI agents.
  • Develop reusable services, APIs, and developer tooling that support AI applications.
  • Build and maintain integrations with modern Agent SDKs and Model Context Protocol (MCP).
  • Design backend microservices using Python and AWS.
  • Build observability into AI systems, including telemetry, monitoring, tracing, and operational visibility.
  • Develop public-facing developer tools and command-line interfaces (CLI).
  • Partner closely with AI researchers to rapidly transition prototypes into production-ready systems.
  • Owning projects from architecture through deployment.
  • Help define engineering standards and reusable patterns across the AI platform.
  • Collaborate with stakeholders across the board in our Product, Sales, and Executive teams.
  • Collaborate with senior engineers while independently leading technical initiatives when appropriate.

Requirements

  • 5+ years of backend software engineering experience.
  • Experience building AI Harnesses is required.
  • Experience with Harness & AI Security is required.
  • Excellent Python development experience.
  • Experience building backend services and microservice architectures.
  • Experience working with AWS cloud services.
  • Experience designing APIs and distributed systems.
  • Hands-on experience building AI applications, AI agents, or agentic workflows.
  • Experience working with Agent SDKs.
  • Familiarity with Model Context Protocol (MCP).
  • Experience building developer tools, APIs, or CLI applications.
  • Strong understanding of software architecture and production engineering.
  • Comfortable working in startup environments with significant ownership.
  • Able to independently drive projects from concept through production.

Preferred Qualifications

  • Experience building Agent Control Planes.
  • Experience implementing embedded controls or policy enforcement within AI agents.
  • Experience building AI observability platforms.
  • Security engineering background.
  • Infrastructure engineering background.
  • Experience building secure AI systems.
  • Experience working with LLMs in production environments.
  • Experience with Kubernetes and containerized services.
  • Experience integrating AI systems with cloud infrastructure.
  • Familiarity with AI governance, guardrails, and runtime s.

Pay

Pay range: $197,000 - $230,000

Bonus & RSUs

Includes bonus and RSU's

Similar jobs

AI Engineer

EMCOR Group, Inc.Norwalk, CT· 2 mo ago
Engineering$135k–$168k/yrapply on careers-emcorgroup.icims.com

AI Engineer

HaystackNew York, NY· 1 mo ago
RemoteEngineeringapply on haystack.cv

AI Engineer

Tessera LabsNew York, NY· 2 mo ago
Engineering$200k–$250k/yrapply on jobs.ashbyhq.com

AI Engineer

ARCO a Family of Construction CompaniesChicago, IL· 3 mo ago
Engineering$28k/yrapply on arco.jibeapply.com

AI Engineer

Mercedes-Benz Vans, LLC (Charleston, SC)Charleston, SC· 3 mo ago
Engineeringapply on jobs.mercedes-benz.com