AI QA Engineer

Responsibilities

• Validate AI-generated outputs and application behavior to ensure accuracy, consistency, and expected functionality
• Execute manual and automated testing activities across AI-enabled applications and cloud-based systems
• Identify, document, track, and communicate software defects, inconsistencies, and unexpected system behavior
• Collaborate with software engineers, cloud teams, DevOps teams, and business stakeholders to troubleshoot and resolve issues
• Support testing activities within CI/CD and cloud deployment environments
• Perform functional, regression, integration, and workflow testing across modern software applications
• Utilize QA and testing tools to support validation, automation, and system reliability
• Review APIs, workflows, and application integrations to validate expected system behavior
• Assist with the development and maintenance of testing procedures, validation standards, and QA documentation
• Analyze recurring issues and recommend process improvements to improve software quality and operational efficiency
• Participate in Agile/Scrum ceremonies and collaborate within cross-functional technical teams
• Ensure testing activities align with technical, operational, and business requirements

Required Qualifications

• 4+ years of experience in Software QA, Testing, SDET, Technical Business Analysis, or a related technical role
• Experience working in cloud-based or DevOps-oriented software environments
• 1–2 years of exposure to AI-enabled systems, AI-assisted workflows, or AI validation/testing activities
• Experience executing structured software testing and QA processes
• Strong attention to detail with the ability to identify defects, inconsistencies, and unexpected system behavior
• Familiarity with APIs, software testing methodologies, and modern application workflows
• Strong analytical, written, and verbal communication skills
• Ability to work independently and collaborate effectively within technical teams in a remote environment

Preferred Qualifications

• Experience with AI/ML workflow or labeling tools such as Labelbox, Amazon SageMaker, or MLFlow
• Experience with testing and automation tools such as Selenium, Postman, JUnit, PyTest, Jenkins, or GitHub
• Experience supporting CI/CD workflows and cloud-native application environments
• Familiarity with Agile/Scrum software development methodologies
• Experience in federal government or regulated environment

Benefits

• Health insurance coverage
• Life and disability insurance
• 401(k) savings plan
• Training and career development opportunities
• Paid holidays and paid time off (PTO)