Staff AI Engineer

GreenLite · New York, NY · 6 mo ago

On-siteEngineering$86/hrFull-time

About the role

We are seeking a key hire in our AI engineering organization to design and ship production agents. This role involves composing multi-step graphs with Strands-based reasoning/tooling and developing internal/external tools for targeting heterogeneous datasets. The ideal candidate will also operationalize on Bedrock AgentCore, stand up task-level and end-to-end evals, and partner with Data to wire agents to building-code knowledge.

Responsibilities

Design & ship production agents: Own one or more high-impact agent workflows (e.g., Permit Intake Triage, Smart Document QA, Compliance Comment Copilot, Code Lookup inside LiteTable).
Compose multi-step graphs (LangGraph) with Strands-based reasoning/tooling and develop internal/external tools for targeting heterogeneous datasets.
Operationalize on Bedrock AgentCore: Use Runtime for secure, scalable hosting and streaming; Gateway to expose APIs as agent-ready tools; Memory for persistent context; Identity for least-privilege access; Observability for traces/metrics; and built-in Browser/Code-Interpreter where appropriate.
Evaluation & safety harness: Stand up task-level and end-to-end evals (success rate, cost, latency, human-handoff rate) and regression suites; borrow ideas from AgentBench/WebArena/SWE-bench where useful but bias toward domain-grounded tests for permitting.
Retrieval & knowledge: Partner with Data to wire agents to building-code knowledge (RAG), evaluate vector store options (incl. S3 Vectors preview, or Pinecone) and set up durable knowledge interfaces the agents can trust.
UX handoffs: Collaborate with Product/Design to craft agent-first reviewer UX in LiteTable (great inline citations, diffs, and remediation suggestions).
Quality & reliability: Build fault-tolerant flows (retries/rollbacks/compensation), observability dashboards, and on-call runbooks for agent incidents.
Technical leadership: Create internal libraries/templates for agent patterns; mentor engineers; review designs with domain experts (architects/code officials).

Requirements

7–12+ years shipping high-reliability backend or ML systems (Python/TypeScript), cloud infra (AWS), containers (ECS/EKS), CI/CD, IaC, and secure integration patterns.

Hands-on with RAG, document stores/vector DBs (bonus: knowledge of Pinecone or early exposure to S3 Vectors), schema/versioning for code texts and comments.

Ability to design realistic, auditable testbeds; familiarity with agent benchmarks (and their pitfalls) and how to turn real user flows into acceptance tests.

Policy-driven guardrails (Grounding checks, topic/word filters), auditability, and human-in-the-loop controls.

Curiosity for building codes, plan sets, and reviewer workflows; comfort working with messy PDFs/CAD and plan-review UX.

Comfort with Bedrock AgentCore knowledge (Runtime, Memory, Gateway, Identity, Observability, and built-in Browser/Code-Interpreter).

Qualifications

Agent frameworks: Depth with LangGraph (graph orchestration, state, recovery) and Strands Agents (structured tool reasoning).

Experience integrating MCP clients/servers.

Skills

Agent frameworks: Depth with LangGraph (graph orchestration, state, recovery) and Strands Agents (structured tool reasoning).
Production chops: 7–12+ years shipping high-reliability backend or ML systems (Python/TypeScript), cloud infra (AWS), containers (ECS/EKS), CI/CD, IaC, and secure integration patterns.
Retrieval & data: Hands-on with RAG, document stores/vector DBs (bonus: knowledge of Pinecone or early exposure to S3 Vectors), schema/versioning for code texts and comments.
Evaluation mindset: Ability to design realistic, auditable testbeds; familiarity with agent benchmarks (and their pitfalls) and how to turn real user flows into acceptance tests.
Safety & governance: Policy-driven guardrails (Grounding checks, topic/word filters), auditability, and human-in-the-loop controls.
Domain empathy: Curiosity for building codes, plan sets, and reviewer workflows; comfort working with messy PDFs/CAD and plan-review UX.
Bedrock AgentCore knowledge: Comfort with Runtime (session isolation, 8-hour sessions, large payloads), Memory, Gateway, Identity, Observability, and built-in Browser/Code-Interpreter.

Benefits

Competitive Compensation - Generous base salary & access to our Employee Equity Program, so you can grow with us.

Performance-Based Annual Bonuses - Rewards for high-impact results and contributions that move the needle.

Premium Health Coverage - Comprehensive medical, dental, and vision insurance for full-time team members and their families.

401(k) Retirement Plan - Helping you invest in your future with smart saving options.

Parental Leave - Generous parental leave for all parents to support your growing family.

Wellness Support - Monthly Wellness Stipend and full access to Wellhub, Talkspace, & Teladoc for your physical and mental well-being.

Weekly Team Lunches - Enjoy catered lunches every week in our NYC office.

Hybrid Work Environment – Our team thrives on collaboration, so we’re in the office 4 days per week. In the summer, we switch to a 3-day in-office schedule to give everyone extra flexibility.

Pay

Competitive compensation based on experience and qualifications.

Schedule

Flexible work schedule with 4 days in the office per week, switching to a 3-day in-office schedule in the summer.