Test Automation Engineer

About This Role

Overwatch is seeking a Test Automation Engineer to own and evolve how we validate edge-deployed imaging systems across software, Jetson-based compute, and hardware-integrated sensor payloads—through automation, tooling, and AI-assisted testing.

What You’ll Do

• End-to-End System Testing
  • Design and execute tests across UI, APIs, backend, and Jetson-based systems.
  • Translate customer issues into reproducible test cases.
  • Define expected behavior, tolerances, and failure conditions.
  • Identify edge cases and integration gaps.
• Test Automation & Tooling
  • Build and maintain automated regression and integration tests.
  • Develop tools for:
    • Test orchestration and execution.
    • Log collection, parsing, and failure detection.
    • Test telemetry and reporting.
  • Expand coverage while reducing manual testing.
• Hardware Integration Validation
  • Validate software that runs on Jetson devices and interfaces with in-house smart-sensors and third-party payloads.
  • Reproduce and debug software ↔ hardware issues.
  • Turn integration failures into repeatable tests.
  • Maintain and support Hardware-in-the-loop (HIL) setups.
• Field Issue Troubleshooting
  • Investigate and reproduce customer-reported issues.
  • Build tools and workflows for faster debugging (logs, replay, diagnostics).
  • Feed findings back into automated test coverage.
• AI-Assisted Testing
  • Apply AI where it improves validation: UI testing (e.g., Playwright).
  • Log analysis and anomaly detection.
  • Evolve testing toward more adaptive, intelligent systems.

Who You Are

• 5+ years of experience in test automation and hardware/software validation.
• Comfortable working with software deployed to edge hardware (Jetson devices or similar).
• Strong systems thinking across software and hardware.
• Experience building test automation, tools, or frameworks.
• Proficient in Python and Linux environments.
• Bonus: Experience with HIL testing, Playwright, or AI-assisted testing.

Summary

This role combines system-level testing, automation, and real-world debugging. You will build the infrastructure and workflows that ensure our software and hardware systems work reliably in the field.

What We Offer

• Growth Opportunities: Learn by doing and shape our future.
• Impact Opportunity: Work on missions that matter to keep people safe and make the world better, and do it at the speed of a startup.
• Late Start Wednesday: A weekly block to have focus time away from meetings and calls.
• Time Off: Generous unlimited PTO policy.
• Medical and Dental premiums 100% covered.
• 401K Matching.

Summary

This role combines system-level testing, automation, and real-world debugging. You will build the infrastructure and workflows that ensure our software and hardware systems work reliably in the field.

Company Information

• We are an equal opportunity workplace and make employment decisions based on merit and business needs, regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity, Veteran status, or any other protected personal characteristic.