Principal Software Engineer

About the role

Develop and deliver commercial software solutions for AI inference acceleration. Design, implement, and optimize high-performance software for serving frameworks like vLLM. Analyze and improve the performance of neural networks on complex multi-core architectures. Collaborate with cross-functional teams throughout the product development lifecycle. Lead and contribute to the planning and execution of large-scale software projects.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field, with 8+ years of relevant engineering experience.
• Proven experience delivering large commercial software projects with a focus on serving frameworks.
• Strong development skills in PyTorch, C++, and Python.
• Deep understanding of LLMs, multi-modal models, and reasoning models.
• Expertise in analyzing and optimizing neural network performance on multicore systems and understanding of SoC architectures.
• Excellent communication and teamwork skills.

Benefits

• Competitive salary range and a comprehensive benefits package.
• Opportunity to work on groundbreaking AI technologies with a leading company.
• Chance to influence product development from inception to deployment.
• A fast-paced, collaborative, and innovative work environment.