Senior Quality Engineering Architect
About the role
We're looking for a Senior Quality Engineering Architect to lead the next generation of test automation and AI-enabled quality engineering. This role serves as a technical authority for test automation and AI-led quality engineering across one or more platform portfolios.
Responsibilities
Design and govern enterprise-grade Playwright/TypeScript automation frameworks — page objects, fixtures, reporters, CI integration, and intelligent test execution.
Evaluate test automation frameworks, tools, and patterns; make build-vs-buy recommendations and drive consistency across teams.
Lead proof-of-concepts for AI-driven test generation, autonomous test maintenance, intelligent defect triage, and agentic testing; translate experiments into production-grade adoption playbooks.
Design AI integration points across the QE stack — self-healing locators, prompt-driven test generation, LLM evaluation pipelines (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard), and RAG/MCP for test data and tooling.
Serve as the senior technical voice that engineers escalate to for framework, architecture, and tooling decisions; resolve technical debt at the architectural level.
Mentor automation engineers across all levels; run technical brown bags, code reviews, and capability-building sessions.
Provide technical oversight and quality assurance for work delivered by a mix of full-time engineers and managed-service contractors.
Partner with engineering, DevSecOps, platform, and product teams to embed quality at the architectural layer.
Establish responsible AI governance for AI-led QE practices, including evaluation standards, prompt-quality criteria, and model-output reliability.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
- 10+ years of experience in software quality engineering, with deep technical individual-contributor track experience.
- Proven framework architect with a track record of designing and shipping enterprise-grade Playwright/TypeScript or comparable automation frameworks adopted by multiple teams.
- Hands-on technical depth across UI, API, mobile, intelligent test execution, performance, and accessibility testing — writes code daily.
- Strong AI fluency — LLM-assisted test generation, AI model quality evaluation, prompt engineering, agentic workflows, RAG and MCP concepts; experience with LLM evaluation tooling (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard) preferred.
- Demonstrated experience providing technical oversight to a mix of full-time engineers and managed-service contractors.
- Track record mentoring engineers across all levels with measurable impact on team capability.
- Comfort with ambiguity, a builder mindset, and the ability to translate experiments into production patterns.
Qualifications
- At least 5 years of experience in a similar role.
- Experience with Playwright and TypeScript.
- Experience with AI and machine learning tools and techniques.
- Experience with agile methodologies and continuous integration/continuous delivery (CI/CD).
Skills
- Playwright and TypeScript.
- AI and machine learning.
- Agile methodologies and CI/CD.
Benefits
- Comprehensive medical benefits package.
- Annual incentive bonus.
- 12% employer contribution to a 401(k) or pension plan.
Pay
$120,000 - $160,000 per year.
Schedule
Flexible working arrangements including remote/hybrid.
Location
Based in approved jurisdictions in the United States or India.