Manager, Large Language Model Inference

About the role

For our client, we are seeking a Manager Large Language Model Inference to join the team of a leader in the Telecommunications & Hardware space. This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will work across engineering, product, operations, and business stakeholders to translate complex requirements into practical technology solutions. The position offers the opportunity to influence architecture, execution quality, and the technology capabilities that enable long-term growth within a Telecommunications & Hardware environment.

Location

Remote - US based candidates only, no visa sponsorship available

Compensation

$184,000 – $356,500 annually

Responsibilities

• Lead a team focused on kernel development and runtime optimizations for LLM inference
• Drive the design, development, and delivery of software for the company's hardware platforms
• Integrate advanced technologies for an enhanced developer experience with LLM deployment
• Oversee software development execution, project planning, and milestone delivery

Qualifications

• MS, PhD, or equivalent in Computer Science, Computer Engineering, AI, or related field
• 7+ years of software engineering experience, including 3+ years in a leadership role
• Experience leading and scaling cross-functional engineering teams
• Proficiency in C++ or Python with a track record of delivering production-quality software
• Expertise in large language models (LLMs) or vision language models (VLMs)

Benefits

• Access to equity opportunities
• Hybrid working model
• Professional development opportunities
• Cutting-edge technological environment
• Collaboration with industry-leading experts at the company