IT Engineer, Internal AI Infrastructure
Figma · New York, NY · 3 days ago
Engineering$153k–$296k/yrFull-time
About the role
Figma is seeking a skilled engineer to anchor the Infrastructure & Hosting pillar of our Internal AI team. This role involves designing and building the runtime layer for internal AI applications, bots, and agents, ensuring they are hosted and executed efficiently. The position requires strong system design skills, experience with LLM operations, and hands-on experience with identity and access management.
Responsibilities
- Design and build the hosting golden path for internal AI applications, bots, and agents, including runtime patterns for long-running workflows, scheduled jobs, and agent execution
- Build the model routing layer that directs tasks across frontier and lower-cost models based on cost, capability, and policy with a full audit trail
- Stand up observability, usage analytics, audit logging, and per-team cost attribution for AI workloads across the company
- Integrate identity, access, and security patterns (Okta-connected by default) so every internal AI app is safe on day one, including the sanctioned path for workflows touching customer, financial, or people data
- Partner with engineers on our product AI infrastructure teams to share gateways and telemetry rather than building parallel systems
- Help shape the team's platform strategy, roadmap, and engineering best practices as a founding member of the infrastructure pillar
Requirements
- 5+ years of software engineering experience, with significant time in infrastructure, platform, or backend engineering
- A track record of building internal platforms or paved paths that other engineers and teams adopted, not just maintained
- Excellent communication skills collaborating across security, IT, and business teams
- Strong system design skills and experience architecting resilient, observable production systems
- Hands-on experience with LLM operations: model gateways or routing, agent runtimes, evals, or cost/usage instrumentation
- Experience with identity and access management in an enterprise environment (e.g., Okta, SSO, secure service-to-service auth)
Qualifications
- Experience building internal AI platforms or workspaces (the Ramp Glass / JPMorgan LLM Suite category) or developer platforms at a comparable scale
- Familiarity with MCP, agent orchestration frameworks, or skill/plugin registry patterns
- Experience working within audit and compliance programs (SOX/ITGC)
- A history of being the first infrastructure hire on a small team, comfortable setting standards from scratch across a broad scope of responsibilities
Skills
- Experience with LLM operations: model gateways or routing, agent runtimes, evals, or cost/usage instrumentation
- Experience with identity and access management in an enterprise environment (e.g., Okta, SSO, secure service-to-service auth)
Benefits
- Competitive health, dental, and vision coverage
- Retirement benefits with company contributions
- Paid sick leave, holidays, and other leave benefits
- Mental health and wellness benefits
- Paid time off
- Company recharge days
- Cell phone and home internet reimbursements
- Lifestyle spending accounts
Pay
- Annual Base Salary Range: $153,000—$296,000 USD
Schedule
- Full time role that can be held from one of our US hubs or remotely in the United States
Application
To apply, please visit our careers page at [insert link here].