Jobs · Engineering · California

Software Engineer, AI Runtime & Platform Services

CrewAI · San Francisco, CA · 4 days ago
HybridEngineeringFull-time

About the role

You'll work on the enterprise runtime layer that turns CrewAI's open-source Crews and Flows into secure, observable, remotely executable production systems. This is the layer between the framework and the platform: APIs, workers, checkpoints, webhooks, auth, deployment behavior, telemetry, and enterprise extensions that make CrewAI run reliably in real customer environments.

Responsibilities

  • Build and maintain the Python enterprise runtime around CrewAI: FastAPI services, Celery workers, Redis-backed state, execution APIs, and deployment-facing tools
  • Extend open-source CrewAI behavior for enterprise environments while preserving compatibility with upstream framework changes
  • Own production execution flows: crew and flow kickoff, status, retries, cancellation, checkpoint restore and fork, chat/session state, and human-in-the-loop resume paths
  • Build secure integration surfaces: JWT auth, signed webhooks, token refresh, file handling, secret fetching, and workload identity across AWS, GCP, and Azure
  • Improve observability across distributed execution: OpenTelemetry traces, structured logs, Sentry, event tracking, and debuggability across API, worker, and platform boundaries
  • Maintain strong test coverage for async/runtime behavior using pytest, mypy, ruff, mocks/fakes, and e2e deployment harnesses
  • Partner with the Agent Management Platform team on API contracts, versioning, enterprise client behavior, deployment status, and failure reporting

Requirements

  • Strong Python backend/platform engineering experience, especially building production services rather than only libraries
  • Experience with FastAPI or similar API frameworks, Celery or other job systems, Redis, Pydantic, and typed Python
  • Good instincts for distributed systems: retries, idempotency, async execution, status tracking, race conditions, and failure recovery
  • Comfort with auth and security-sensitive systems: JWTs, webhooks, signatures, secrets, IAM/workload identity, and least-privilege thinking
  • Practical observability experience: tracing, structured logging, metrics, Sentry/OpenTelemetry, and debugging multi-service failures
  • Strong testing habits and comfort with CI, package/version management, and release discipline

Bonus Experience

  • Operating AI/agent runtimes, workflow engines, or distributed task systems
  • Cloud platform experience with AWS ECS/ECR, Kubernetes, Helm, GCP/Azure identity, or secret managers
  • Experience with enterprise SaaS constraints: auditability, tenant isolation, customer environments, deployment rollbacks, and supportability
  • Familiarity with Rails/SaaS platforms

Similar jobs

AI & Platform Engineer

Villanova UniversityVillanova, PA· 1 mo ago
Engineering$112k–$124k/yrapply on jobs.villanova.edu