Principal Software Engineer
Haystack · San Diego, CA · Today
RemoteRemoteEngineeringFull-time
We're hiring on behalf of a Haystack partner! The Role Develop and deliver commercial software solutions for AI inference acceleration. Design, implement, and optimize high-performance software for serving frameworks like vLLM. Analyze and improve the performance of neural networks on complex multi-core architectures. Collaborate with cross-functional teams throughout the product development lifecycle. Lead and contribute to the planning and execution of large-scale software projects. What You'll Need Bachelor's degree in Computer Science, Engineering, or a related field, with 8+ years of relevant engineering experience. Proven experience delivering large commercial software projects with a focus on serving frameworks. Strong development skills in PyTorch, C++, and Python. Deep understanding of LLMs, multi-modal models, and reasoning models. Expertise in analyzing and optimizing neural network performance on multicore systems and understanding of SoC architectures. Excellent communication and teamwork skills. What's On Offer Competitive salary range and a comprehensive benefits package. Opportunity to work on groundbreaking AI technologies with a leading company. Chance to influence product development from inception to deployment. A fast-paced, collaborative, and innovative work environment. Apply via Haystack today!