Jobs · Engineering · New York

IT Engineer, Internal AI Infrastructure

Figma · New York, NY · 3 days ago
Engineering$153k–$296k/yrFull-time

About the role

Figma is seeking a skilled engineer to anchor the Infrastructure & Hosting pillar of our Internal AI team. This role involves designing and building the runtime layer for internal AI applications, bots, and agents, ensuring they are hosted and executed efficiently. The position requires strong system design skills, experience with LLM operations, and hands-on experience with identity and access management.

Responsibilities

  • Design and build the hosting golden path for internal AI applications, bots, and agents, including runtime patterns for long-running workflows, scheduled jobs, and agent execution
  • Build the model routing layer that directs tasks across frontier and lower-cost models based on cost, capability, and policy with a full audit trail
  • Stand up observability, usage analytics, audit logging, and per-team cost attribution for AI workloads across the company
  • Integrate identity, access, and security patterns (Okta-connected by default) so every internal AI app is safe on day one, including the sanctioned path for workflows touching customer, financial, or people data
  • Partner with engineers on our product AI infrastructure teams to share gateways and telemetry rather than building parallel systems
  • Help shape the team's platform strategy, roadmap, and engineering best practices as a founding member of the infrastructure pillar

Requirements

  • 5+ years of software engineering experience, with significant time in infrastructure, platform, or backend engineering
  • A track record of building internal platforms or paved paths that other engineers and teams adopted, not just maintained
  • Excellent communication skills collaborating across security, IT, and business teams
  • Strong system design skills and experience architecting resilient, observable production systems
  • Hands-on experience with LLM operations: model gateways or routing, agent runtimes, evals, or cost/usage instrumentation
  • Experience with identity and access management in an enterprise environment (e.g., Okta, SSO, secure service-to-service auth)

Qualifications

  • Experience building internal AI platforms or workspaces (the Ramp Glass / JPMorgan LLM Suite category) or developer platforms at a comparable scale
  • Familiarity with MCP, agent orchestration frameworks, or skill/plugin registry patterns
  • Experience working within audit and compliance programs (SOX/ITGC)
  • A history of being the first infrastructure hire on a small team, comfortable setting standards from scratch across a broad scope of responsibilities

Skills

  • Experience with LLM operations: model gateways or routing, agent runtimes, evals, or cost/usage instrumentation
  • Experience with identity and access management in an enterprise environment (e.g., Okta, SSO, secure service-to-service auth)

Benefits

  • Competitive health, dental, and vision coverage
  • Retirement benefits with company contributions
  • Paid sick leave, holidays, and other leave benefits
  • Mental health and wellness benefits
  • Paid time off
  • Company recharge days
  • Cell phone and home internet reimbursements
  • Lifestyle spending accounts

Pay

  • Annual Base Salary Range: $153,000—$296,000 USD

Schedule

  • Full time role that can be held from one of our US hubs or remotely in the United States

Application

To apply, please visit our careers page at [insert link here].

Similar jobs

AI Engineer (IT)

LevitonMelville, NY· 1 mo ago
RemoteDesign$145k–$155k/yrapply on careers.leviton.com

AI Engineer

Dechert LLPPhiladelphia, PA· 1 mo ago
Engineeringapply on dechert.wd12.myworkdayjobs.com

AI Engineer

Tata Consultancy ServicesAtlanta, GA· 1 mo ago
Engineeringapply on ibegin.tcsapps.com

AI Engineer

Goal SolutionsSan Diego, CA· 1 mo ago
Researchapply on recruiting.paylocity.com

AI Engineer

PepsiCoChicago, IL· 2 mo ago
Engineeringapply on pepsicojobs.com