Jobs · Quality Assurance · California

Senior Quality Engineer

OutSystems · San Francisco County, CA · 2 wk ago
Quality AssuranceFull-time

Role Overview

As a Senior AI Quality Engineer, you will be the strategic lead for quality within our AI-powered product ecosystem. This role extends beyond traditional QA responsibilities; you will be responsible for defining how we validate non-deterministic AI outputs and complex microservices. You will lead the integration of AI tools, utilizing applications like Claude Code, Cursor, and Gemini to evolve our SDLC toward high-velocity, AI-augmented delivery. You will guide the quality strategy for high-impact initiatives, ensuring that our AI products are functional, reliable, ethical, and scalable.

Core Responsibilities

  • AI-First Test Strategy & Planning: Define and implement the end-to-end test strategy for major AI product areas. Align testing goals with broader engineering objectives.
  • AI-Augmented Automation: Provide technical leadership for complex automation challenges. Support the adoption of Cursor and Claude Code to refactor frameworks, generate synthetic data, and automate the creation of sophisticated test suites.
  • Advanced Test Design: Lead the team in designing coverage for AI-based features, including prompt injection testing, model hallucination checks, and performance benchmarking. Mentor junior engineers on using Gemini to generate use cases.
  • Defect Management & Root Cause Analysis: Lead triage for all defects. Analyze trends in model behavior and system performance to implement systemic improvements to the development pipeline.
  • Intelligent CI/CD Quality Gates: Define and enforce "smart" quality gates within the CI/CD pipeline. Hold responsibility for automated suites, ensuring they are reliable, efficient, and capable of catching regressions in both code and model output.
  • Strategic Reporting & Mentorship: Report on quality metrics and team velocity to stakeholders. Document AI-testing standards and formally mentor the team on integrating Generative AI into their daily engineering workflows.

Required Qualifications

  • AI Toolchain Expertise: Advanced experience using AI coding assistants (Claude Code, Cursor) and LLMs (Gemini, GPT-4) to accelerate the SDLC.
  • SDLC Leadership: Proven track record of managing product delivery in an Agile environment with a focus on CI/CD and automated quality gates.
  • Technical Stack: Proficiency in C#, Python or JavaScript and experience with modern testing frameworks (e.g., Playwright, PyTest).
  • Autonomy: Ability to drive initiatives from ideation to completion with minimal oversight, requiring only strategic alignment with leadership.
  • Educational/Experience: 5+ years in Quality Engineering or Software Development, with a significant focus on automated systems and AI-based applications.

Why Join Us?

We are evolving away from legacy testing mindsets. In this role, you have the autonomy to experiment with the latest AI tools to solve the most complex problems in software quality. If you want to build the blueprint for how AI-based products are delivered to millions of users, this is an ideal opportunity for you.

Salary Range (base)

$204k - $235k

Scope, Complexity, and Impact

  • Scope: Lead quality initiatives for an entire product module or end-to-end user workflows, establishing the quality framework for key components of our core AI engine.
  • Complexity: Solve systemic quality issues, balancing the mitigation of technical debt with the rapid pace of AI innovation.
  • Impact: High. Your work directly influences team-wide velocity and ensures the long-term stability and trustworthiness of our AI products.

More about OutSystems

OutSystems is a leading AI Development Platform built for the enterprise. Global organizations trust OutSystems to rapidly build mission-critical apps and agents, modernize legacy processes with agentic systems, and govern their entire AI portfolio across complex regulatory environments, all on one unified platform. As the future becomes agentic, our customers need us now more than ever. While AI has opened the door to extraordinary possibilities, most large organizations find themselves stuck on one side of the "enterprise gap" because AI by itself doesn't solve their complex use cases and business challenges. OutSystems bridges the "enterprise gap" by combining the speed of generative AI with a deterministic, enterprise-grade framework. We provide the tools for teams of any size to deliver high-quality, reliable AI solutions that drive real business impact. We are looking for passionate, talented, and motivated people to join us as we empower organizations to build, deploy, and scale the next generation of enterprise software. While we are leading the charge into the agentic era, our mission is broader: we are the platform enterprise leaders trust to evolve their entire business, accelerating innovation through secure, governed human-AI collaboration.

Working at OutSystems

Our culture is built on our core values of Trust, Customer Success, Innovation, and Alignment. We operate as one global OutSystems team, taking ownership to pursue our vision of being the AI platform enterprise leaders trust to build, secure, and evolve their most critical applications and systems. What do we have to offer you? A company at the vanguard of the agentic revolution, where we don’t just react to AI innovation—we architect it. Joining OutSystems means stepping onto a high-growth rocket ship that combines the fearless agility of a startup with the sophisticated, global foundation of an enterprise powerhouse. Real growth opportunities. We don't just talk about development; we invest in it through structured programs designed to scale your expertise. Whether you are aiming for vertical progression, exploring lateral moves into new domains, or mastering specialized AI skills through our Professional Development Fund and Internal Mobility Program, we provide the resources to get you there. A global collective of world-class talent, where you’ll collaborate with enterprise software legends and sought-after thought leaders. At OutSystems, our industry experts aren't just visionaries—they are accessible, approachable mentors who are deeply invested in your growth as we architect the agentic future together. OutSystems nurtures an inclusive culture where talented individuals from all backgrounds are empowered to learn, experiment and make an impact. We believe that driving our next phase of growth requires the radical creativity that only comes from diverse perspectives. We are committed to building a team as global and diverse as the organizations we serve, ensuring every individual can perform to their full potential. As an equal opportunity employer, all qualified applicants receive equal consideration regardless of race, origin, religion, sex, sexual orientation, gender identity, disability, veteran status, or any other protected status.

Similar jobs

Senior Quality Engineer

Computershare U.S.St Paul, MN· 6 days ago
Engineering$83k–$119k/yrapply on fa-evdq-saasfaprod1.fa.ocs.oraclecloud.com

Senior Quality Engineer

Willow Innovations, Inc.Mountain View, CA· 4 mo ago
Quality Assurance$180k–$200k/yrapply on job-boards.greenhouse.io

Senior Quality Engineer

CIRCOR International, Inc.Warren, MA· 1 wk ago
Manufacturingapply on recruiting2.ultipro.com