Senior AI QA Engineer

We are working with a leading technology firm at the forefront of AI innovation, developing cutting‑edge solutions that are transforming industries. This company is known for its advanced artificial intelligence capabilities and its commitment to delivering high‑quality, impactful products.

Responsibilities

• Define and execute test scenarios for Generative AI and Agentic AI workflows.
• Validate natural‑language questions and AI‑generated responses against agreed source‑of‑truth results.
• Test NL‑to‑SQL generation, query execution, validation, repair, and result interpretation.
• Validate AI agent workflows, including tool/function calls, routing, retries, fallback behavior, and error handling.
• Test KPI threshold alerts, automated assessments, root‑cause analysis, evidence, and recommended actions.
• Perform functional, integration, regression, API, data, and end‑to‑end testing.

Requirements

• Strong experience in QA/testing of enterprise applications.
• Strong API testing experience.
• Good SQL and data‑validation skills.
• Experience with functional, integration, regression, and end‑to‑end testing.
• Experience testing complex data‑driven applications.
• Understanding of Generative AI / LLM concepts and ability to validate AI‑generated results.

Benefits

• Opportunity to work on cutting‑edge AI technologies.
• Engage with complex, data‑driven applications.
• Collaborative environment with AI Engineers and Architects.

Apply via Haystack today!