Jobs · Engineering · California

VLM & VFM Forward Deployed Engineer

Matroid · Palo Alto, CA · 2 mo ago
On-siteEngineeringFull-time

About the role

Matroid is a full-service computer vision company that has developed an end-to-end platform allowing enterprise customers to rapidly train and deploy automated visual inspection on imagery, including EO, IR, X-Ray, CT, OCT, and others. Founded in 2016 by a Stanford professor, Matroid serves a broad and rapidly growing customer base across manufacturing, automotive, logistics, aerospace, data center infrastructure, and security.

Responsibilities

  • Train and deploy state-of-the-art vision-centric and vision-language models across a broad range of industrial domains, including manufacturing, automotive, logistics, aerospace, data center infrastructure, security, and more.
  • Deploy end-to-end CV systems across a range of environments (cloud, edge, hybrid).
  • Define benchmarks and perform quantitative and qualitative evaluation of the AI systems, including accuracy, reliability, latency, throughput, and/or robustness, and then iterate to meet production requirements.
  • Design and develop industrial-grade imaging systems for high-quality, consistent data collection.
  • Integrate Matroid into customer workflows and systems, such as manufacturing execution systems, PLCs, SCADA systems, quality management systems, safety alert systems, and video management systems, with common industrial protocols.
  • Act as the technical expert, advising on all matters from technical scoping of engagements to model adaptation, deployment architecture, evaluation, integration, and customer enablement.
  • Empower customers with AI by designing and leading product training sessions, technical workshops, and deployment playbooks.
  • Translate real-world business problems into performant computer vision and/or vision language solutions.
  • Select, fine-tune, prompt, evaluate, and orchestrate the right models for the task at hand.
  • Understand and apply the right features, models, workflows, and integrations to solve customer problems.
  • Understand customers' operational requirements and relay feedback to the broader Matroid team to drive customer-centric development.
  • Integrate robust and efficient deep learning systems with third-party systems to deliver real-world impact.
  • Operate in a collaborative yet highly autonomous environment that isn’t bogged down by unnecessary meetings or project management overhead.
  • Leverage new technologies and dive into the world of computer vision and multi-modal AI, both on your own and during frequent company tech talks.

Requirements

  • Bachelor’s degree in computer science, computer engineering, electrical engineering, machine learning, artificial intelligence, or another technical field.
  • Experience working with modern visual recognition models, including object detection, segmentation, tracking, action recognition, anomaly detection, and/or vision-language models for multi-modal understanding, reasoning, and retrieval.
  • Strong Python coding skills, with the ability to build reliable systems that interact with various models, APIs, databases, customer infrastructure, and production workflows.
  • Experience with popular machine learning and computer vision frameworks and tools, such as PyTorch, TensorFlow, JAX, Hugging Face, Numpy, OpenCV, or similar technologies.
  • Strong ability to evaluate AI systems rigorously, including designing benchmarks, analyzing failure modes, and improving model performance through data, prompts, architecture, or workflow design.
  • Solid oral, written, presentation, collaboration, and interpersonal communication skills.
  • Adept at communicating with both technical and commercial audiences.

Qualifications

  • Graduate degree with a concentration in computer vision, artificial intelligence, machine learning, natural language processing, robotics, or related fields.
  • Previous work experience in forward-deployed engineering, field engineering, professional services, consulting, solutions engineering, or another customer-facing technical role.
  • Experience deploying AI systems in industrial, manufacturing, aerospace, logistics, security, or other operational environments.
  • Experience with complex computer vision and vision language tasks, like spatial-temporal reasoning, open-world visual recognition, 3D visual understanding/reconstruction, or agentic workflows.
  • Experience with high-growth technology startups.

Skills

  • Computer vision
  • Vision-language models
  • Multi-modal AI
  • Machine learning
  • Python programming
  • Model adaptation
  • Customer enablement
  • Technical scoping
  • Model evaluation
  • Integration with third-party systems
  • Collaboration
  • Communication

Benefits

  • Competitive pay and equity
  • The chance to constantly work on stimulating intellectual challenges
  • Gym membership reimbursement
  • Free lunch, healthy drinks, and snacks every day
  • Medical, dental, and vision insurance with 100% paid premiums
  • A flexible schedule that leaves time for all of your other interests
  • A budget for whatever hardware or software will make you most effective
  • Resources to learn about the cutting edge of software engineering, computer vision, VLMs, LLMs, and multi-modal AI

Pay

Competitive pay and equity.

Schedule

A flexible schedule that leaves time for all of your other interests.

Similar jobs

Forward Deployed Engineer

Lightning AISan Francisco, CA· 1 wk ago
Engineering$120k–$250k/yrapply on job-boards.greenhouse.io