Machine Learning Engineer - Inference

About the role

Together AI is an AI-native cloud company building infrastructure for AI engineers and application developers. The Machine Learning Engineer will optimize and enhance large-scale AI inference systems, developing production services, tools, and fault-tolerant data processing systems while collaborating with researchers and engineers.

Responsibilities

• Design and build the production systems that power the Together AI inference engine, enabling reliability and performance at scale
• Develop and optimize runtime inference services for large-scale AI applications
• Collaborate with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world
• Conduct design and code reviews to ensure high standards of quality
• Create services, tools, and developer documentation to support the inference engine
• Implement robust and fault-tolerant systems for data ingestion and processing