Principal Software Engineer

About the role

Develop and deliver commercial software solutions for AI inference acceleration. Design, implement, and optimize high-performance software for serving frameworks like vLLM. Analyze and improve the performance of neural networks on complex multi-core architectures. Collaborate with cross-functional teams throughout the product development lifecycle. Lead and contribute to the planning and execution of large-scale software projects.

Responsibilities

• Develop and deliver commercial software solutions for AI inference acceleration
• Design, implement, and optimize high-performance software for serving frameworks like vLLM
• Analyze and improve the performance of neural networks on complex multi-core architectures
• Collaborate with cross-functional teams throughout the product development lifecycle
• Lead and contribute to the planning and execution of large-scale software projects

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field, with 8+ years of relevant engineering experience
• Proven experience delivering large commercial software projects with a focus on serving frameworks
• Strong development skills in PyTorch, C++, and Python
• Deep understanding of LLMs, multi-modal models, and reasoning models
• Expertise in analyzing and optimizing neural network performance on multicore systems and understanding of SoC architectures
• Excellent communication and teamwork skills

Qualifications

Competitive salary range and a comprehensive benefits package. Opportunity to work on groundbreaking AI technologies with a leading company. Chance to influence product development from inception to deployment. A fast-paced, collaborative, and innovative work environment.