VLM & VFM Forward Deployed Engineer
Matroid · Palo Alto, CA · 2 mo ago
On-siteEngineeringFull-time
About the role
Matroid is a full-service computer vision company that has developed an end-to-end platform allowing enterprise customers to rapidly train and deploy automated visual inspection on imagery, including EO, IR, X-Ray, CT, OCT, and others. Founded in 2016 by a Stanford professor, Matroid serves a broad and rapidly growing customer base across manufacturing, automotive, logistics, aerospace, data center infrastructure, and security.
Responsibilities
- Train and deploy state-of-the-art vision-centric and vision-language models across a broad range of industrial domains, including manufacturing, automotive, logistics, aerospace, data center infrastructure, security, and more.
- Deploy end-to-end CV systems across a range of environments (cloud, edge, hybrid).
- Define benchmarks and perform quantitative and qualitative evaluation of the AI systems, including accuracy, reliability, latency, throughput, and/or robustness, and then iterate to meet production requirements.
- Design and develop industrial-grade imaging systems for high-quality, consistent data collection.
- Integrate Matroid into customer workflows and systems, such as manufacturing execution systems, PLCs, SCADA systems, quality management systems, safety alert systems, and video management systems, with common industrial protocols.
- Act as the technical expert, advising on all matters from technical scoping of engagements to model adaptation, deployment architecture, evaluation, integration, and customer enablement.
- Empower customers with AI by designing and leading product training sessions, technical workshops, and deployment playbooks.
- Translate real-world business problems into performant computer vision and/or vision language solutions.
- Select, fine-tune, prompt, evaluate, and orchestrate the right models for the task at hand.
- Understand and apply the right features, models, workflows, and integrations to solve customer problems.
- Understand customers' operational requirements and relay feedback to the broader Matroid team to drive customer-centric development.
- Integrate robust and efficient deep learning systems with third-party systems to deliver real-world impact.
- Operate in a collaborative yet highly autonomous environment that isn’t bogged down by unnecessary meetings or project management overhead.
- Leverage new technologies and dive into the world of computer vision and multi-modal AI, both on your own and during frequent company tech talks.
Requirements
- Bachelor’s degree in computer science, computer engineering, electrical engineering, machine learning, artificial intelligence, or another technical field.
- Experience working with modern visual recognition models, including object detection, segmentation, tracking, action recognition, anomaly detection, and/or vision-language models for multi-modal understanding, reasoning, and retrieval.
- Strong Python coding skills, with the ability to build reliable systems that interact with various models, APIs, databases, customer infrastructure, and production workflows.
- Experience with popular machine learning and computer vision frameworks and tools, such as PyTorch, TensorFlow, JAX, Hugging Face, Numpy, OpenCV, or similar technologies.
- Strong ability to evaluate AI systems rigorously, including designing benchmarks, analyzing failure modes, and improving model performance through data, prompts, architecture, or workflow design.
- Solid oral, written, presentation, collaboration, and interpersonal communication skills.
- Adept at communicating with both technical and commercial audiences.
Qualifications
- Graduate degree with a concentration in computer vision, artificial intelligence, machine learning, natural language processing, robotics, or related fields.
- Previous work experience in forward-deployed engineering, field engineering, professional services, consulting, solutions engineering, or another customer-facing technical role.
- Experience deploying AI systems in industrial, manufacturing, aerospace, logistics, security, or other operational environments.
- Experience with complex computer vision and vision language tasks, like spatial-temporal reasoning, open-world visual recognition, 3D visual understanding/reconstruction, or agentic workflows.
- Experience with high-growth technology startups.
Skills
- Computer vision
- Vision-language models
- Multi-modal AI
- Machine learning
- Python programming
- Model adaptation
- Customer enablement
- Technical scoping
- Model evaluation
- Integration with third-party systems
- Collaboration
- Communication
Benefits
- Competitive pay and equity
- The chance to constantly work on stimulating intellectual challenges
- Gym membership reimbursement
- Free lunch, healthy drinks, and snacks every day
- Medical, dental, and vision insurance with 100% paid premiums
- A flexible schedule that leaves time for all of your other interests
- A budget for whatever hardware or software will make you most effective
- Resources to learn about the cutting edge of software engineering, computer vision, VLMs, LLMs, and multi-modal AI
Pay
Competitive pay and equity.
Schedule
A flexible schedule that leaves time for all of your other interests.