Senior Engineering Manager, AI

About the role

Lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will work across engineering, product, operations, and business stakeholders to translate complex requirements into practical technology solutions. The position offers the opportunity to influence architecture, execution quality, and the technology capabilities that enable long-term growth within a technology-driven environment.

Location: Remote - US based candidates only, no visa sponsorship available.

Responsibilities

• Lead and mentor a highly skilled team of up to 10 senior engineers
• Cultivate a culture of technical excellence and career growth
• Oversee strategy and architecture for an AI Gateway processing 1 trillion tokens per week
• Guide integration with multiple LLM vendors and optimize system performance
• Collaborate with product management and AI research to align gateway features and goals
• Establish software engineering best practices and architectural standards

Qualifications

• 5-7 years of engineering management experience leading high-performing teams
• Extensive experience with distributed system architecture
• Deep understanding of high-throughput, low-latency systems
• Exceptional communication skills for cross-team collaboration
• Familiarity with modern AI tools and methodologies
• Experience with technologies like Python, Java, and enterprise-grade systems (preferred)
• Knowledge of AI frameworks such as LangChain or LiteLLM (nice to have)

Benefits

• Generous benefits program
• Opportunity for equity compensation
• Potential for career advancement in a growing AI-focused organization
• Work with cutting-edge AI technologies
• Collaborative environment with cross-functional teams

Pay

$275,000 – $375,000 annually