Jobs · Art & Creative · Virginia

Senior Quality Engineering Architect

CFA Institute · Charlottesville, VA · 1 wk ago
Art & Creative$120k–$160k/yrFull-time

About the role

We're looking for a Senior Quality Engineering Architect to lead the next generation of test automation and AI-enabled quality engineering. This role serves as a technical authority for test automation and AI-led quality engineering across one or more platform portfolios.

Responsibilities

  • Design and govern enterprise-grade Playwright/TypeScript automation frameworks — page objects, fixtures, reporters, CI integration, and intelligent test execution.

  • Evaluate test automation frameworks, tools, and patterns; make build-vs-buy recommendations and drive consistency across teams.

  • Lead proof-of-concepts for AI-driven test generation, autonomous test maintenance, intelligent defect triage, and agentic testing; translate experiments into production-grade adoption playbooks.

  • Design AI integration points across the QE stack — self-healing locators, prompt-driven test generation, LLM evaluation pipelines (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard), and RAG/MCP for test data and tooling.

  • Serve as the senior technical voice that engineers escalate to for framework, architecture, and tooling decisions; resolve technical debt at the architectural level.

  • Mentor automation engineers across all levels; run technical brown bags, code reviews, and capability-building sessions.

  • Provide technical oversight and quality assurance for work delivered by a mix of full-time engineers and managed-service contractors.

  • Partner with engineering, DevSecOps, platform, and product teams to embed quality at the architectural layer.

  • Establish responsible AI governance for AI-led QE practices, including evaluation standards, prompt-quality criteria, and model-output reliability.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
  • 10+ years of experience in software quality engineering, with deep technical individual-contributor track experience.
  • Proven framework architect with a track record of designing and shipping enterprise-grade Playwright/TypeScript or comparable automation frameworks adopted by multiple teams.
  • Hands-on technical depth across UI, API, mobile, intelligent test execution, performance, and accessibility testing — writes code daily.
  • Strong AI fluency — LLM-assisted test generation, AI model quality evaluation, prompt engineering, agentic workflows, RAG and MCP concepts; experience with LLM evaluation tooling (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard) preferred.
  • Demonstrated experience providing technical oversight to a mix of full-time engineers and managed-service contractors.
  • Track record mentoring engineers across all levels with measurable impact on team capability.
  • Comfort with ambiguity, a builder mindset, and the ability to translate experiments into production patterns.

Qualifications

  • At least 5 years of experience in a similar role.
  • Experience with Playwright and TypeScript.
  • Experience with AI and machine learning tools and techniques.
  • Experience with agile methodologies and continuous integration/continuous delivery (CI/CD).

Skills

  • Playwright and TypeScript.
  • AI and machine learning.
  • Agile methodologies and CI/CD.

Benefits

  • Comprehensive medical benefits package.
  • Annual incentive bonus.
  • 12% employer contribution to a 401(k) or pension plan.

Pay

$120,000 - $160,000 per year.

Schedule

Flexible working arrangements including remote/hybrid.

Location

Based in approved jurisdictions in the United States or India.

Similar jobs

Senior Engineer/Architect

M&J EngineeringRockville, MD· 7 mo ago
Art & Creative$180k–$220k/yrapply on careers-mjengineers.icims.com

Senior Quality Engineer

Tactile MedicalMinneapolis, MN· 1 wk ago
Quality Assurance$94k–$131k/yrapply on job-boards.greenhouse.io