Perception Engineer

About the role

The Perception Engineer will own the perception stack across the entire factory, integrating vision, vibration, thermal, force, and other sensor systems. They will build and integrate these systems into production processes, feeding data into cost models, cycle time predictions, and nesting optimizations.

Responsibilities

• Own the perception stack across the entire factory, including vision, vibration, thermal, force, and any other sensor that provides valuable data.
• Build vision systems for robotics, inspection, dimensional verification, defect detection, and material identification.
• Develop sensor systems on saws, CNC equipment, and automated cells, focusing on vibration for blade wear, thermal for cut conditions, current draw for load, and other relevant data points.
• Collate and analyze data from various sensors, feeding it into job costing, cycle time prediction, and nesting optimization models.
• Deploy and maintain edge inference systems where appropriate, and develop cloud-based inference solutions as needed.
• Create and manage data pipelines to capture and process sensor data, ensuring it powers both machine learning models and operational intelligence.
• Collaborate closely with ML, automation, and controls teams to ensure seamless integration and effective use of perception data.
• Conduct experiments, ablations, and real-world tests to validate the effectiveness of perception systems on the factory floor.
• Ensure all systems are safe and reliable, adhering to strict safety protocols and wearing appropriate personal protective equipment (PPE).
• Communicate effectively with operators and other stakeholders to understand their needs and improve the perception systems accordingly.

Requirements

• Strong technical foundation in computer vision, signal processing, and sensor systems.
• Hands-on experience with industrial cameras, machine vision platforms, and 2D and 3D imaging technologies.
• Experience with non-vision sensors such as accelerometers, vibration sensors, thermal sensors, current sensors, and force sensors.
• Proficiency in modern ML and DL frameworks like PyTorch, JAX, OpenCV, or similar.
• Experience integrating perception systems into PLCs, robotics, and production software.
• Comfortable with software development, API creation, and model deployment in production environments.
• Tight collaboration with ML, automation, and controls teams in previous roles.
• Experience deploying perception systems in metals, machining, or industrial settings.
• Background in vibration analysis, predictive maintenance, or condition monitoring.
• Experience with thermal imaging or thermography in process control.
• Hands-on experience with edge inference platforms like NVIDIA Jetson, OpenVINO, Coral, or comparable.
• Experience with 3D vision, structured light, stereo, or LiDAR technologies.
• Open-source contributions, published research, or a portfolio of perception systems built.

Qualifications

• Strong technical foundation in computer vision, signal processing, and sensor systems.
• Hands-on experience with industrial cameras, machine vision platforms, and 2D and 3D imaging technologies.
• Experience with non-vision sensors such as accelerometers, vibration sensors, thermal sensors, current sensors, and force sensors.
• Proficiency in modern ML and DL frameworks like PyTorch, JAX, OpenCV, or similar.
• Experience integrating perception systems into PLCs, robotics, and production software.
• Tight collaboration with ML, automation, and controls teams in previous roles.
• Experience deploying perception systems in metals, machining, or industrial settings.
• Background in vibration analysis, predictive maintenance, or condition monitoring.
• Experience with thermal imaging or thermography in process control.
• Hands-on experience with edge inference platforms like NVIDIA Jetson, OpenVINO, Coral, or comparable.
• Experience with 3D vision, structured light, stereo, or LiDAR technologies.
• Open-source contributions, published research, or a portfolio of perception systems built.

Skills

• Strong technical foundation in computer vision, signal processing, and sensor systems.
• Hands-on experience with industrial cameras, machine vision platforms, and 2D and 3D imaging technologies.
• Experience with non-vision sensors such as accelerometers, vibration sensors, thermal sensors, current sensors, and force sensors.
• Proficiency in modern ML and DL frameworks like PyTorch, JAX, OpenCV, or similar.
• Experience integrating perception systems into PLCs, robotics, and production software.
• Tight collaboration with ML, automation, and controls teams in previous roles.
• Experience deploying perception systems in metals, machining, or industrial settings.
• Background in vibration analysis, predictive maintenance, or condition monitoring.
• Experience with thermal imaging or thermography in process control.
• Hands-on experience with edge inference platforms like NVIDIA Jetson, OpenVINO, Coral, or comparable.
• Experience with 3D vision, structured light, stereo, or LiDAR technologies.
• Open-source contributions, published research, or a portfolio of perception systems built.

Benefits

• Opportunity for long-term career growth within a rapidly evolving industry.
• Competitive compensation package tailored to experience and performance.
• Flexible work schedule to accommodate the unique demands of the manufacturing environment.
• Health insurance, retirement plans, and other comprehensive benefits.
• Professional development opportunities through training programs and workshops.
• Work-life balance with generous paid time off and flexible scheduling.

Pay

Competitive salary commensurate with experience and qualifications.

Schedule

Full-time position requiring in-person presence in Detroit, MI.