Generative AI - ML System Engineering

About the role

We are looking for Machine Learning Systems Engineers to help build the world's largest end-to-end 3D native machine learning systems. You will work on building our end to end ML framework dedicated for 3D, from pretraining, to finetuning, inferencing, etc.

Responsibilities

• Work closely with researchers to co-design the next frontier of 3D & Spatial AI.
• Build and debug on top of modern PyTorch, for maximum parallelism and efficiency.
• Create clean and intuitive training infrastructure for our in-house foundational models.
• Identify bottlenecks and optimize for high throughput & efficient distributed model training across hundreds to thousands of GPUs.
• Implement and maintain 3D specific custom operators in Triton or CUDA.
• Implement and maintain novel data-loading framework and libraries.
• Build efficient inference endpoints with complex multi-stage model pipelines.
• Optimize models through compilation, fusion, quantization, etc.

Requirements

• Experience in machine learning or high performance graphics.
• Strong practical understanding of at least one machine learning framework (e.g. PyTorch, JAX).
• Strong ability to write beautiful and maintainable code in Python and/or C++.
• Ability to learn fast and dive into new concepts or complex codebases.
• Performance and efficiency oriented mindset, with a strong interest in the tiniest detail.
• Strong communication skills for working in a globally distributed team.

Qualifications

• A strong passion to navigate through the PyTorch internals, with hands-on experience in areas like torch.compile, fully_shard (FSDP2) APIs.
• Experience with building Triton kernels.
• Familiarity with large-scale distributed training, modern parallelization techniques: DP, TP, CP, PP, zero redundancy optimizers, etc.
• Experience with diffusion models in 3D or video.
• Experience with low precision bf16 or fp8 training.

Skills

• Experience with machine learning frameworks (PyTorch, JAX).
• Knowledge of modern parallelization techniques.
• Experience with diffusion models in 3D or video.
• Experience with low precision training.

Benefits

Trusted by Meta, Square Enix, Deepmind and more, Meshy is redefining 3D creation with generative AI. We empower artists, designers, engineers, hobbyists, and makers to bring immersive worlds, characters, and experiences to reality in minutes instead of months. In addition to our core mission of unleashing creativity, we build a culture that we enjoy and are proud of. Here are some highlights: We value intelligence and the pursuit of knowledge. We are a global team of generative-AI pioneers, computer-graphics veterans, and product builders who believe human expression and enjoyment is the ultimate frontier of computing. We care deeply about our work, our users, and each other. Empathy and passion drive us forward. We have a culture of directness and truthfulness, therefore we value constructive criticism. Being direct and truthful is the most sincere form of trust and care. We trust our instincts and are not afraid to take bold risks. Meshy was born from a few-hour prototype, a bold pivot for a team that had very little experience in AI. Innovation requires courage.

Pay

Competitive salary based on experience.

Schedule

Full-time, remote work option available.