Jobs · Engineering · New York

Applied Research Scientist / Engineer

Luma · Albany, New York Metropolitan Area · 3 wk ago
HybridEngineeringFull-time

About the role

This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma’s foundation models and drive real-world value. You’ll sit at the intersection of research, product, and partnerships, helping close the gap between state-of-the-art and production-ready.

What You'll Do

  • You will work as a fullstack applied researcher across modeling, data, systems, and evaluation to adapt and deploy models to production.
  • Controllability and Features: You will leverage a toolkit spanning SFT, RL, personalization, distillation, control adapters, and more, to develop and maintain model variants purpose-built for user environments and creative partners.
  • Personalization: Architect the data engine for rapid adaptation. You will leverage proprietary, vertical-specific datasets to create specialized finetunes and improve future training recipes, ensuring our models rely on data that reflects real-world use cases.
  • End-User Quality: You will define and drive end-user quality – setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific enterprise verticals.
  • Cross-functional Collaboration: Partner closely with Product, Research, and Design to translate creative intent and user feedback into model behavior, intuitive controls, and production-ready capabilities for users and partners.

Who You Are

  • Product-Obsessed Researcher/Engineer: You treat end users and partners as collaborators and enjoy solving specific “last mile” problems—not just optimizing public metrics.
  • ML Expert: Strong ML fundamentals with deep experience in visual generative models (diffusion/transformers or related architectures). Ideal candidates also have a deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
  • Hands-On Builder: Strong Python and deep learning engineering skills (ideally PyTorch), comfortable moving between research prototypes and production systems. Bonus Points: Contributions to state-of-the-art models in image/video generation. Experience collaborating with creative partners (VFX, animation, film, design tools). Track record building workflows/tools that materially improve iteration speed and evaluation rigor. Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).

Similar jobs