DirectJobHub
Jobs · Information Technology · New York

Founding Infrastructure Engineer

Structured AI · New York, NY · 1 wk ago
On-siteInformation Technology$180k–$250k/yrFull-time

About the role

You would be the first infrastructure hire on a team of ten engineers, owning the platform that runs AI agents that check construction drawings and CAD models. You would set the technical direction for the underlying product, overseeing a sandboxed, isolated execution platform with warm pools for instant startup and controlled network egress, a worker fleet that scales from zero to hundreds of jobs, the LLM traffic layer for multi‑tenant metered token usage, streaming for chat and progress updates, the document pipeline for rendering, OCR, and extraction on large PDFs, and CI/CD, self‑hosted runners, and incident response.

Responsibilities

  • The execution platform that runs AI agents: sandboxed and isolated, with warm pools for instant startup and controlled network egress.
  • The worker fleet: thousands of sheets per project, scaling from zero to hundreds of jobs and back.
  • The LLM traffic layer: multi‑tenant, metered, every token accounted for in customer billing.
  • Streaming for chat and progress updates that survives deploys and dropped connections.
  • The document pipeline: rendering, OCR, extraction on very large PDFs.
  • CI/CD, the self‑hosted runner fleet, and incident response.

Requirements

  • At least 3 years of running cloud infrastructure in production (Azure, AWS, or GCP; Azure experience is a plus but not required).
  • Proven experience isolating workloads in production using containers, microVMs, or Linux sandboxing in a system with real users.
  • Experience running AI agents inside containers is a strong plus.
  • Daily use of Claude Code and Codex is expected.

Qualifications

  • Deep expertise in containers and isolation, not tied to any specific tool.
  • Ability to decide how parts of the platform should be run and to set technical direction.
  • Comfort working with Claude Code and Codex on a daily basis.

Skills

  • Azure Container Apps with KEDA‑scaled jobs
  • Bicep
  • GitHub Actions
  • Postgres
  • Redis
  • Azure Front Door
  • Entra ID (Azure AD)
  • Working with models from Anthropic, Gemini, and OpenAI
  • Proficiency with Claude Code and Codex

Benefits

  • Up to 1% equity
  • YC‑backed company with revenue
  • Small, impactful team of 10 engineers

Pay

Base salary range of $180,000 to $250,000 per year, plus up to 1% equity.

Schedule

Role is based in the office in the Financial District, New York,

Similar jobs