Senior/Staff Software Engineer - Machine Learning Platform (Inference)

Responsibilities

• Help define and own the roadmap, working collaboratively and proactively with senior architects, PMs, and team leadership.
• The initiatives include platforms and tools that enable customers to do state-of-the-art machine learning on Snowflake natively.
• Collaboratively build and execute a vision for incorporating new advances in machine learning in ways that best achieve the team’s business objectives.
• Ensure operational excellence of the services and meet the commitments to our customers regarding reliability, availability, and performance.
• Collaborate across other ML partner teams to continuously improve ML development velocity and capabilities at Snowflake.
• Support team members in delivering a high level of technical quality.

Ideal Requirements & Qualifications

• Have 7+ years of industry experience designing, building, and supporting Internet serving infrastructure, machine learning platforms, machine learning services, and frameworks.
• Strong track record of working with machine learning systems and/or platforms.
• Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them.
• Experience serving fine-tuned LLMs (PEFT, DPO, RL).
• Experience with several of the following frameworks: SKLearn, XGBoost, PyTorch, Tensorflow, MLflow is a plus.
• Previous experience in building batch and real-time ML serving systems preferred.
• Have built a roadmap and vision around machine learning teams, and led technical decision making with help of architects and PMs and team.
• BS/MS/PhD in Computer Science or related majors, or equivalent experience.