Jobs · Information Technology

AI Solutions Architect – Quality Strategy

Crawford & Company · United States · 1 mo ago
RemoteRemoteInformation TechnologyFull-time

About the Role

We're looking for a strategic leader to drive our Quality-at-Source vision and transform how quality is embedded across engineering teams.

Responsibilities

  • Lead the design and conversion of legacy quality assurance processes into a modern, continuous improvement framework with shift-left testing and validation
  • Establish, evangelize, and implement TDD and BDD methodologies across the entire application portfolio to ensure code is testable and requirements are executable
  • Own the ultimate validation and verification of the SDLC, ensuring that quality is baked into the CI/CD pipeline and local development environments
  • Design and implement concrete validation pipelines for AI-assisted development outputs, including:
    • Prompt engineering standards — Establish reusable prompt templates and guardrails for agentic code generation, with version-controlled prompt libraries
    • Output validation gates — Build automated checks that evaluate AI-generated code against security, style, and correctness baselines before it enters the review cycle
    • Non-deterministic testing frameworks — Develop assertion strategies for AI outputs where exact results vary (e.g., confidence-scored evaluations, boundary testing, regression suites against known-good outputs)
    • Human-in-the-loop checkpoints — Define which categories of AI output require manual review (UX decisions, business logic, security-sensitive code) and build the workflow tooling to surface them efficiently
  • Own an evaluation-driven roadmap for AI developer tools. Each tool adoption must include a measurable hypothesis (e.g., “AI-assisted test generation reduces test authoring time by 40% within 90 days”) with a defined pilot, measurement period, and go/no-go criteria before org-wide rollout
  • Develop and deliver training programs that teach development teams to treat AI agents as junior developers — validating outputs, writing effective prompts, and designing workflows where AI acceleration doesn’t bypass quality gates
  • Use persuasion and diplomacy to bridge gaps between product, engineering, and operations, moving the organization toward a collaborative "Quality First" mindset
  • Lead at the company as a pioneer in AI-driven quality engineering and software validation in general
  • Define acceptance criteria quality standards — Work with product managers to ensure stories include testable acceptance criteria before engineering begins work
  • Authority to flag and return insufficiently specified work to product before it enters a sprint
  • Establish a structured process where product, engineering, and QA co-author behavioral specifications (Given/When/Then) before development begins, ensuring shared understanding of "correct"

Qualifications

  • Advanced Degree in related field required
  • Minimum of seven years of related experience is required
  • Prior management/supervisory experience is required

Technical Expertise

  • A strong background in software development (e.g., Java, Python, or C#, node ecosystem) with a genuine passion for the art of code verification
  • Deep experience in building and optimizing CI/CD pipelines and local developer workflows
  • Proven track record of successfully deploying TDD and BDD at an enterprise scale
  • Strong experience in AI assisted development with an emphasis on building validation into the AI generation

Leadership Traits

  • A focus on metrics that matter (e.g., Lead Time, Change Failure Rate, and Mean Time to Recovery)
  • Ability to influence senior stakeholders and mentor junior engineers simultaneously
  • Obsessed with the evolving landscape of AI and engineering tooling

Preferred Qualifications

  • ISTQB Test Manager or ASQ Certified Software Quality Engineer (CSQE)
  • Project Management Professional (PMP) or Certified Scrum Master (CSM)
  • AWS Certified Developer

Benefits

  • Competitive base pay
  • Bonus/Incentive Pay and other Performance-Based Rewards, if applicable
  • Medical, Dental and Vision Plans
  • Prescription Drugs
  • HSA, HRA, and FSA Accounts
  • Paid Holidays, Vacation and Sick Leave
  • 401(k) Retirement Plan
  • Tuition Assistance
  • Paid Parental Leave
  • Supplemental Health Benefits
  • Enhanced Mental Health Support
  • Virtual Physical Therapy
  • Caregiving Services
  • Life Assistance Program
  • Training programs that promote continuous learning and career progression while enhancing job performance
  • Sustainability programs that give back to the communities in which we live and work
  • A culture of respect, collaboration, entrepreneurial spirit and inclusion

Similar jobs

AI Solutions Architect

Thomson ReutersEagan, MN· 2 mo ago
RemoteEngineering$100k/yrapply on thomsonreuters.wd5.myworkdayjobs.com

AI Solutions Architect

Thomson ReutersAnn Arbor, MI· 2 mo ago
RemoteEngineering$100k/yrapply on thomsonreuters.wd5.myworkdayjobs.com

AI Solutions Architect

Thomson ReutersNew York, NY· 2 mo ago
RemoteEngineering$100k/yrapply on thomsonreuters.wd5.myworkdayjobs.com