Test Engineer III
Heartflow · San Francisco, CA · 3 days ago
EngineeringFull-time
Responsibilities
- Build and maintain automated end-to-end (E2E) tests covering complete user workflows across UI, API, and back-end services, under the technical direction of the Test Architect and Senior Test Engineer.
- Actively explore and apply AI-assisted test automation techniques, including AI-assisted authoring, self-healing locators, generative test design, and AI-supported triage, and bring back recommendations on new tools and approaches worth adopting team-wide.
- Execute post-deployment verification activities such as production smoke tests and monitoring-driven checks, including contributing to a new baseline of daily smoke tests across environments.
- Contribute to test plans, test protocols, and test reports under the guidance of senior engineers, ensuring documentation meets QMS expectations.
- Participate in tool validation activities for test infrastructure and automation tooling per internal procedures.
- Implement and maintain UI test automation using Selenium and Playwright; follow established framework patterns and contribute improvements and modernization ideas.
- Develop API-level tests using tools such as REST Assured, Postman, Karate, Pact.io.
- Translate requirements and user stories into clear, traceable test cases in partnership with engineers, product, and RA/QA.
- Investigate test failures, file high-quality defect reports, and partner with developers to drive issues to resolution.
- Help keep automated tests running reliably in CI/CD pipelines and respond promptly to pipeline breakages.
- Provide test evidence and documentation to support audits, CAPAs, and regulatory submissions as requested.
- Partner closely with the Test Architect and Senior Test Engineer to learn HeartFlow's ML pipeline, clinical computation services, and Workstation/reporting systems, and grow into owning larger pieces of the automation strategy over time.
Qualifications
- 3–5 years of experience in software test engineering, SDET, or quality engineering roles, with a hands-on automation focus.
- Genuine enthusiasm for AI-assisted and emerging test automation tools and techniques, this role is as much about mindset and curiosity as it is about existing depth.
- Experience testing Software as a Medical Device (SaMD) or other regulated medical device software preferred; strong candidates from other regulated or quality-critical environments will also be considered.
- Working familiarity with medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation and traceability.
- Proficiency with Selenium / WebDriver and Playwright, including writing stable, maintainable UI automation.
- Hands-on experience contributing to E2E automation suites and test frameworks.
- Exposure to authoring or maintaining test plans, protocols, and reports in a regulated environment.
- Praactical use of AI-assisted testing tools or techniques (e.g., AI-augmented test authoring, self-healing automation, LLM-supported triage) or strong motivation and aptitude to ramp quickly.
- Solid programming skills in Python and/or another mainstream automation language (e.g., TypeScript/JavaScript, Java, or C#).
- Experience with API testing tools (REST Assured, Postman, Karate, Pact.io or equivalent).
- Familiarity with CI/CD systems (e.g., GitHub Actions, Jenkins, GitLab CI) and basic exposure to cloud environments such as AWS.
- Strong debugging skills and a structured approach to investigating failures.
- Clear written and verbal communication; able to document test designs and defects effectively, and to advocate for new tools and ideas within the team.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.