Senior GenAI Backend Software Engineer (773)

Responsibilities

• Develop, test, and maintain robust container based microservice API architectures on Kubernetes clusters.
• Design and develop high-quality, scalable software products supporting our customer’s security, safety, and privacy of GenAI and LLM-based systems with advanced guardrail capabilities.
• Integrate GenAI systems including LLM, VectorDB, RAG pipelines, agents, and guardrails into the delivery of our product features.
• Develop state of the art guardrails and systems leveraging agent workflows and tooling to support safety and security of GenAI.
• Monitor, debug, and troubleshoot production issues.
• Collaborate closely with other software engineers, product teams, AI researchers, and security specialists to deliver enterprise-grade software products and features for safe, secure, and private consumption of GenAI.
• Evaluate and integrate open-source tools and third-party platforms to accelerate product development.

Requirements

• 10+ years of experience in backend software engineering with strong expertise in GenAI and LLM, and a focus on scaling of GenAI solutions.
• Expertise developing and maintaining GenAI workflows including RAG workflows and prompt engineering techniques.
• Experience developing and scaling cloud solutions using APIs, containers and microservice architectures with Kubernetes, Docker, Helm, etc.
• Experience with integrating software products using authentication and authorization including cloud IAM, SSO, JWT, oAuth, etc.
• Strong skills in Python with experience in cloud environments (e.g., AWS, Google Cloud, Azure).
• Familiarity with version control tools, CI/CD pipelines and DevOps practices.
• Demonstrated ability to build and manage complex, distributed systems supporting enterprise solutions.