Jobs · Engineering

Senior Applied AI Engineer

Function Health · United States · 1 wk ago
RemoteRemoteEngineering$298/hrFull-time

Key Responsibilities

  • Architect and build stateful, graph-based agent workflows with tool use, planning, and memory.
  • Integrate LLMs and multimodal models via structured I/O (JSON Schema, Pydantic validators) and function/tool calling.
  • Build high-reliability APIs and streaming services for real-time inference, speech, and vision.
  • Own production readiness: tracing, logging, metrics, rate limiting, circuit breakers, and SLOs.
  • Stand up eval pipelines: offline golden sets, LLM-as-judge with human rubrics, online A/B, and regression tests in CI.
  • Implement retrieval and memory: hybrid search, vector and graph retrieval, semantic caches, and long-horizon context.
  • Optimize cost/latency: model routing, prompt and tool selection, quantization, and KV cache/prefill strategies.
  • Partner cross-functionally to translate research into robust production systems and iterate quickly behind evaluation gates.
  • Mentor engineers through design docs and architecture decisions.

Qualifications/Skills

  • 1+ years building agentic AI systems;
  • 6+ years as a full-stack or ML engineer, building production backends or ML systems in Python, Go, or similar;
  • Fluency with agentic orchestration (e.g., LangGraph, PydanticAI, DSPy, LlamaIndex) and tool/function calling;
  • Experience integrating frontier LLMs and multimodal models via managed APIs or self-hosted serving;
  • Strong with API design and backend frameworks (FastAPI, Flask) and event-driven architectures;
  • Data systems expertise with PostgreSQL, including token streaming and throughput tuning;
  • Retrieval and memory: vector databases (pgvector, Pinecone, Weaviate, Milvus), hybrid search, and graph/knowledge storage;
  • Production evals: LLM-as-judge, human-in-the-loop, rubric design, and CI-integrated regression tests;
  • Observability and SRE: OpenTelemetry traces, metrics, structured logs, SLOs, dashboards, and on-call triage;
  • Cloud-native delivery: Kubernetes, Terraform, Docker, GPU scheduling/autoscaling on AWS or GCP;
  • CI/CD proficiency with GitHub Actions and test automation for prompts, tools, and agents;
  • Clear, concise communication and high ownership in fast-paced environments.

Nice To Haves

  • Real-time multimodal systems: streaming ASR, low-latency TTS, WebRTC, and vision pipelines;
  • RAG expertise beyond basics: Graph RAG, multi-hop retrieval, sub-agents, query planning, and freshness policies;
  • Safety and governance: policy-as-code, red-teaming, PII handling, audit logs, and role-based tool authorization;
  • Regulated data experience (HIPAA, SOC 2, GDPR) and data residency controls;
  • Personalization at inference time, long-term memory agents, session state, and episodic memory stores;
  • Experience with consumer-scale AI apps, high-traffic systems, or on-device/edge acceleration (WebGPU).

To Be a Strong Fit

  • Ruthless Prioritization:
  • Member-First, Always:
  • One Team, Moving Fast:
  • Radical Ownership, Relentless Execution:
  • Mission Over Ego:
  • Sustained Integrity in Every Detail:

Similar jobs

Senior Applied AI Engineer

GrayMatter RoboticsLos Angeles Metropolitan Area· 5 mo ago
Information Technologyapply on jobs.ashbyhq.com