Senior Engineering Manager, AI

About the role

To support our growth, we are searching for a Senior Engineering Manager to lead the AI Platform team. This group builds and operates our core AI Gateway, serving as the critical high-throughput highway for all Large Language Model (LLM) traffic across the entire AlphaSense ecosystem.

Responsibilities

• Strategic Team Leadership: Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America).
• Foster a high-performance culture of technical excellence, predictable delivery, and career growth.
• High-Scale Operations & Scaling: Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as SuperAnalyst) - while ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms.
• Multi-Vendor Orchestration: Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers.
• Cross-Functional Alignment: Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
• Technical Governance: Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.

Requirements

Proven Engineering Leadership: Strong track record of managing and growing high-performing teams of senior and staff engineers, with a passion for developing technical leaders and aligning engineering objectives with business strategy.

Enterprise Scale Experience: Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).

Technical Thought Leadership: Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.

Strategic Communication: Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.

Modern Tooling & AI-First Mindset: Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.

Nice to Have:

• Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
• Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
• Experience with Python, Java, and highly distributed caching/queueing systems.

Qualifications

Minimum Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 7+ years of relevant experience in software engineering and/or engineering management.
• Experience leading and mentoring a team of engineers.
• Strong understanding of distributed systems and cloud-native architectures.
• Experience with large-scale data processing and analytics.

Preferred Qualifications:

• Master’s degree in Computer Science, Engineering, or related field.
• Experience with large-scale AI platforms and models.
• Experience with large-scale distributed systems and microservices.
• Experience with Kubernetes, Docker, and container orchestration.

Skills

• Strong leadership and communication skills.
• Experience with distributed systems and cloud-native architectures.
• Ability to manage and mentor a team of engineers.
• Experience with large-scale data processing and analytics.
• Knowledge of modern software development practices and tools.
• Experience with large-scale AI platforms and models.
• Experience with large-scale distributed systems and microservices.
• Experience with Kubernetes, Docker, and container orchestration.

Benefits

We offer a competitive benefits package that includes:

• Health insurance
• Dental insurance
• Vision insurance
• Paid time off
• Flexible spending accounts
• Retirement savings plan
• Employee assistance programs
• Professional development opportunities

Pay

Base compensation is set based on function and level benchmarked against similar stage growth companies and internal comparables. Final offer amounts are determined by multiple factors including candidate experience/expertise and may vary from the amounts listed below.

Compensation Range: $361,200—$496,800 USD

Schedule

Full-time position

Company

AlphaSense is an equal-opportunity employer. We are committed to a work environment that supports, inspires, and respects all individuals. All employees share in the responsibility for fulfilling AlphaSense’s commitment to equal employment opportunity. AlphaSense does not discriminate against any employee or applicant on the basis of race, color, sex (including pregnancy), national origin, age, religion, marital status, sexual orientation, gender identity, gender expression, military or veteran status, disability, or any other non-merit factor. This policy applies to every aspect of employment at AlphaSense, including recruitment, hiring, training, advancement, and termination. In addition, it is the policy of AlphaSense to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations, and ordinances where a particular employee works.

Recruiting Scams and Fraud

We At AlphaSense Have Been Made Aware Of Fraudulent Job Postings And Individuals Impersonating AlphaSense Recruiters. These Scams May Involve Fake Job Offers, Requests For Sensitive Personal Information, Or Demands For Payment. Please Note AlphaSense never asks candidates to pay for job applications, equipment, or training.

All official communications will come from an @alpha-sense.com email address.

If you’re unsure about a job posting or recruiter, verify it on our Careers page. If you believe you’ve been targeted by a scam or have any doubts regarding the authenticity of any job listing purportedly from or on behalf of AlphaSense please contact us. Your security and trust matter to us.