Senior Software Engineer (AI / LLMs)

About the role

Apiphani is a technology-enabled managed services company dedicated to redefining what it means to support mission-critical enterprise workloads. We’re a small but rapidly growing company, which means there’s lots of room for growth and learning opportunities abound!

Responsibilities

• Design and implement backend services that enable intelligent agent workflows and autonomous infrastructure actions
• Develop APIs and orchestration layers in Python and TypeScript, integrating LLMs, vector databases, and observability pipelines
• Build scalable systems to support LLM-based reasoning, retrieval, and decision-making across cloud infrastructure
• Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities
• Develop data access and semantic search layers using vector databases (e.g., pgvector, Pinecone, Qdrant)
• Build robust monitoring, testing, and CI/CD systems to ensure reliability and reproducibility of AI workflows
• Collaborate closely with the product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health
• Write clean, maintainable code with clear documentation and strong adherence to security and performance best practices
• Participate in code reviews, design discussions, and iterative delivery cycles to improve product velocity and quality

Requirements

• 6+ years of backend engineering experience in production environments
• Strong proficiency in Python and TypeScript for building distributed, event-driven systems
• Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.)
• Experience designing APIs, microservices, and event pipelines that interface with LLMs or AI models
• Familiarity with vector databases and concepts like embeddings, similarity search, and retrieval-augmented generation
• Experience with infrastructure-as-code tools such as Terraform or AWS CDK
• Understanding of SQL and schema migration workflows (PostgreSQL or similar)
• Hands-on experience with Docker, GitHub Actions, and cloud-native CI/CD workflows
• Able to diagram systems, communicate architecture decisions clearly, and work asynchronously in a distributed team
• Strong sense of ownership and ability to deliver in fast-moving, ambiguous environments

Bonus points

• Experience working with LangChain, OpenAI, or Anthropic APIs
• Familiarity with agentic frameworks or AI orchestration systems
• Background in observability or APM tooling (e.g., Datadog, Dynatrace)
• Prior experience building automation or infrastructure management tools
• Contributions to open-source LLM or MLOps projects
• Interest in shaping how AI is applied to real-world IT operations

Company Benefits

• Medical/dental/vision - 100% paid for employees, 50% paid for dependents
• Life and disability - 100% paid for employees
• 401K - 3% contribution, no employee contribution necessary
• Education and tuition reimbursement
• Accident, critical illness, hospital indemnity benefits offered through our providers
• Employee Assistance Program
• Legal assistance
• Paid Time Off - up to 6 weeks per year
• Sick Leave - up to 2 weeks per year
• Parental Leave - up to 12 weeks