Principal Software Engineer

About the role

Develop and deliver commercial software solutions for AI inference acceleration. Design, implement, and optimize high-performance software for serving frameworks like vLLM. Analyze and improve the performance of neural networks on complex multi-core architectures. Collaborate with cross-functional teams throughout the product development lifecycle. Lead and contribute to the planning and execution of large-scale software projects.

Responsibilities

• Develop and deliver commercial software solutions for AI inference acceleration.
• Design, implement, and optimize high-performance software for serving frameworks like vLLM.
• Analyze and improve the performance of neural networks on complex multi-core architectures.
• Collaborate with cross-functional teams throughout the product development lifecycle.
• Lead and contribute to the planning and execution of large-scale software projects.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field, with 8+ years of relevant engineering experience.
• Proven experience delivering large commercial software projects with a focus on serving frameworks.
• Strong development skills in PyTorch, C++, and Python.
• Deep understanding of LLMs, multi-modal models, and reasoning models.
• Expertise in analyzing and optimizing neural network performance on multicore systems and understanding of SoC architectures.
• Excellent communication and teamwork skills.

Qualifications

Competitive salary range and a comprehensive benefits package. Opportunity to work on groundbreaking AI technologies with a leading company. Chance to influence product development from inception to deployment. A fast-paced, collaborative, and innovative work environment.