QA Engineer, AI Automation

About The Company Twin Health is a pioneering digital health company dedicated to transforming the management and prevention of chronic metabolic diseases such as type 2 diabetes and obesity. By leveraging innovative AI Digital Twin technology, Twin Health creates personalized metabolic models for each individual, utilizing data from continuous glucose monitors (CGMs), smartwatches, meal logs, and other health metrics. This approach enables tailored treatment plans that empower members to achieve significant health improvements, including lowering A1C levels below diabetic ranges, attaining sustainable weight loss, and reducing or eliminating medications. Recognized for its innovation and positive workplace culture, Twin Health has received numerous accolades, including Innovator of the Year by the Employer Health Innovation Roundtable, inclusion in CB Insights’ Digital Health 150, and being named one of Newsweek’s Top Most Loved Workplaces. With substantial funding from leading venture firms like ICONIQ Growth, Sequoia, Sofina, Temasek, and Peak XV, Twin Health is rapidly scaling its impact across the United States and globally, aiming to set a new standard of care in metabolic health. About The Role We are seeking an experienced AI Automation QA Engineer to join our dynamic team. The ideal candidate will possess extensive manual testing skills combined with expertise in AI-driven test automation. This role involves developing comprehensive regression test coverage for complex web and mobile applications, ensuring the highest quality standards in a fast-paced enterprise or startup environment. The successful candidate will work closely with stakeholders to derive detailed test plans, design and implement AI-enhanced automated testing strategies, and contribute to evaluating and validating internally developed models. Additionally, this role involves automating data generation for testing scenarios, collaborating with developers, product managers, and UX designers to deliver an exceptional user experience, and continuously evolving testing infrastructure to leverage agentic AI capabilities for rapid test generation and healing. The position offers a unique opportunity to be part of a cutting-edge health technology company committed to innovation and impactful solutions in metabolic health. Qualifications Bachelor’s degree in Computer Science, Software Engineering, or a related fieldMinimum of 3 years of experience in QA engineering with a focus on test automationProven experience testing web UIs and mobile applications (iOS, Android, Flutter)Strong programming skills in Java, Python, or JavaScriptHands-on experience with automation tools such as Playwright, Maestro, Appium, or SeleniumSolid understanding of SQL databases and experience with test data generationExperience testing REST API backends for high-scale consumer applicationsFamiliarity with automated performance testing tools like jMeter or LocustExperience developing AI-driven regression automation using models like Claude or similarExcellent verbal and written communication skillsStrong analytical and critical thinking abilitiesExperience building and maintaining evaluation frameworks for internal models is a plusKnowledge of healthcare, biosensors, or conversational agent validation is a plus Responsibilities Collaborate with stakeholders to derive comprehensive end-to-end regression test cases and test plans covering critical application functionalitiesDesign, implement, and maintain robust AI-driven automated regression test suites for web and mobile applicationsContribute to the evaluation and validation of internally developed models, ensuring accuracy and reliabilityDevelop AI-enabled automated testing strategies, including rapid prompt-driven test generation and test healing techniquesDesign and develop automated data generation processes to support testing scenariosWork closely with developers, product managers, and UX designers to ensure seamless delivery of a high-quality user experience across the integrated application ecosystemContinuously improve testing infrastructure by integrating new AI tools and methodologiesParticipate in troubleshooting, debugging, and resolving automation issuesDocument testing processes, results, and improvements for ongoing quality assurancePerform other duties as assigned to support project goals and team success Benefits Competitive annual salary ranging from $130,000 to $140,000 USDComprehensive health, dental, and vision insurance fully sponsored by the employer for employees, with 80% coverage for family membersHealth Savings Account (HSA) and Flexible Spending Account (FSA) options401(k) retirement savings plan with company contributionsRemote work flexibility with a collaborative global teamOpportunity for equity participation in a rapidly growing innovative companyUnlimited vacation policy subject to managerial approvalPaid parental leave: 16 weeks fully paid for delivering parents and 8 weeks for non-delivering parentsAccess to cutting-edge health technology and participation in impactful projectsSupportive and inclusive work environment fostering professional growth and development Equal Opportunity Twin Health is an equal opportunity employer committed to creating a diverse and inclusive workplace. We welcome applications from all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, age, national origin, disability status, or any other protected characteristic. We believe that diverse perspectives and backgrounds drive innovation and excellence, and we are dedicated to fostering a workplace where everyone can thrive and contribute to our mission of improving metabolic health worldwide.