Quality Engineer Lead - Local to Pittsburgh, PA

About the role

The Senior Quality Engineering Lead will define and drive the quality strategy, validation standards, and release readiness for the Document Management platform, focusing on user-centric application capabilities and integration across existing enterprise systems.

Responsibilities

• Define and own the end-to-end quality strategy, standards, and release governance
• Establish quality gates, automation frameworks, and validation metrics across application and integration layers
• Partner with Engineering, Product, and Architecture to drive shift-left quality practices and early defect prevention
• Enable data-driven release decisions, providing clear visibility into quality metrics, risks, and readiness
• Provide technical leadership and oversight across QE practices, automation, and continuous improvement
• Define and lead end-to-end validation strategies for document management workflows, including document submission, access, and retrieval across systems
• Establish validation frameworks for search and retrieval capabilities, including: Metadata-driven and full-text search, Vector-based semantic search (embedding similarity, ranking accuracy, relevance tuning), Entitlement enforcement and context-aware results
• Define and govern validation for metadata quality, taxonomy alignment, and data integrity across systems
• Ensure document lifecycle and governance validation, including retention, auditability, traceability, and compliance enforcement
• Lead validation of AI-powered retrieval and agentic workflows, ensuring accuracy, grounding, and consistency
• Lead validation of federated integrations, ensuring consistency in document access, metadata alignment, and cross-system behavior
• Define and oversee testing strategies for API and event-driven integrations, including data integrity, resilience, retry handling, and failure scenarios
• Ensure end-to-end traceability, auditability, and regulatory compliance across application and integration layers
• Define and oversee security and access control validation (RBAC) across all document and retrieval scenarios
• Drive automation-first quality practices, including CI/CD-integrated test pipelines and continuous validation
• Establish quality observability, including dashboards, reporting, and actionable insights on coverage, defects, and system performance

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent practical experience
• 6–10 years of experience in quality engineering, software testing, or enterprise platform validation
• 3+ years leading quality strategy or providing technical leadership on large-scale delivery programs
• Proven experience validating document management systems, enterprise search platforms, or metadata-driven applications
• Strong expertise in test strategy design, quality gates, and automated validation frameworks
• Experience testing API-driven, microservices, and event-driven architectures
• Hands-on experience with Microsoft Azure, CI/CD pipelines, and test automation frameworks
• Strong understanding of: Search relevance and metadata validation, Vector/semantic search and AI-driven retrieval validation
• Experience validating security, RBAC, and compliance controls in regulated environments
• Familiarity with AI/ML, LLM-based retrieval, or agentic workflows
• Strong communication skills with ability to present quality metrics, risks, and release readiness to stakeholders