AI Solutions Architect – Quality Strategy
Crawford & Company · United States · 1 mo ago
RemoteRemoteInformation TechnologyFull-time
About the Role
We're looking for a strategic leader to drive our Quality-at-Source vision and transform how quality is embedded across engineering teams.
Responsibilities
- Lead the design and conversion of legacy quality assurance processes into a modern, continuous improvement framework with shift-left testing and validation
- Establish, evangelize, and implement TDD and BDD methodologies across the entire application portfolio to ensure code is testable and requirements are executable
- Own the ultimate validation and verification of the SDLC, ensuring that quality is baked into the CI/CD pipeline and local development environments
- Design and implement concrete validation pipelines for AI-assisted development outputs, including:
- Prompt engineering standards — Establish reusable prompt templates and guardrails for agentic code generation, with version-controlled prompt libraries
- Output validation gates — Build automated checks that evaluate AI-generated code against security, style, and correctness baselines before it enters the review cycle
- Non-deterministic testing frameworks — Develop assertion strategies for AI outputs where exact results vary (e.g., confidence-scored evaluations, boundary testing, regression suites against known-good outputs)
- Human-in-the-loop checkpoints — Define which categories of AI output require manual review (UX decisions, business logic, security-sensitive code) and build the workflow tooling to surface them efficiently
- Own an evaluation-driven roadmap for AI developer tools. Each tool adoption must include a measurable hypothesis (e.g., “AI-assisted test generation reduces test authoring time by 40% within 90 days”) with a defined pilot, measurement period, and go/no-go criteria before org-wide rollout
- Develop and deliver training programs that teach development teams to treat AI agents as junior developers — validating outputs, writing effective prompts, and designing workflows where AI acceleration doesn’t bypass quality gates
- Use persuasion and diplomacy to bridge gaps between product, engineering, and operations, moving the organization toward a collaborative "Quality First" mindset
- Lead at the company as a pioneer in AI-driven quality engineering and software validation in general
- Define acceptance criteria quality standards — Work with product managers to ensure stories include testable acceptance criteria before engineering begins work
- Authority to flag and return insufficiently specified work to product before it enters a sprint
- Establish a structured process where product, engineering, and QA co-author behavioral specifications (Given/When/Then) before development begins, ensuring shared understanding of "correct"
Qualifications
- Advanced Degree in related field required
- Minimum of seven years of related experience is required
- Prior management/supervisory experience is required
Technical Expertise
- A strong background in software development (e.g., Java, Python, or C#, node ecosystem) with a genuine passion for the art of code verification
- Deep experience in building and optimizing CI/CD pipelines and local developer workflows
- Proven track record of successfully deploying TDD and BDD at an enterprise scale
- Strong experience in AI assisted development with an emphasis on building validation into the AI generation
Leadership Traits
- A focus on metrics that matter (e.g., Lead Time, Change Failure Rate, and Mean Time to Recovery)
- Ability to influence senior stakeholders and mentor junior engineers simultaneously
- Obsessed with the evolving landscape of AI and engineering tooling
Preferred Qualifications
- ISTQB Test Manager or ASQ Certified Software Quality Engineer (CSQE)
- Project Management Professional (PMP) or Certified Scrum Master (CSM)
- AWS Certified Developer
Benefits
- Competitive base pay
- Bonus/Incentive Pay and other Performance-Based Rewards, if applicable
- Medical, Dental and Vision Plans
- Prescription Drugs
- HSA, HRA, and FSA Accounts
- Paid Holidays, Vacation and Sick Leave
- 401(k) Retirement Plan
- Tuition Assistance
- Paid Parental Leave
- Supplemental Health Benefits
- Enhanced Mental Health Support
- Virtual Physical Therapy
- Caregiving Services
- Life Assistance Program
- Training programs that promote continuous learning and career progression while enhancing job performance
- Sustainability programs that give back to the communities in which we live and work
- A culture of respect, collaboration, entrepreneurial spirit and inclusion