Senior QA Engineer
Haystack · United States · 1 mo ago
RemoteRemoteEngineeringFull-time
About the role
A leading technology firm, renowned for its innovative enterprise solutions in AI and data analytics, is seeking a talented professional to join their dynamic team.
Responsibilities
- Test an enterprise Generative AI and Agentic AI platform built using AWS Bedrock and Databricks.
- Validate AI response, agent workflows, Natural Language-to-SQL, and data accuracy.
- Perform KPI assessments, surveillance, security, and end-to-end testing.
- Design and execute functional, integration, regression, API, data, and end-to-end test cases.
- Validate AI-generated responses against source-of-truth data and business rules.
- Work with AI Engineers, Developers, Data Engineers, and Healthcare SMEs to troubleshoot issues.
Requirements
- Strong QA and testing experience with enterprise applications.
- Expertise in API testing, SQL, data validation, and test automation.
- Working understanding of Generative AI/LLM applications, prompts, RAG/grounding, and AI evaluation.
- Basic knowledge of US Healthcare/Medicaid, MMIS, claims, eligibility, providers, and pharmacy data.
- Understanding of HIPAA, PHI/PII, RBAC, and data security.
- Experience with AWS Bedrock and Databricks is preferred.
Benefits
- Opportunity to work on cutting-edge Generative AI and Agentic AI platforms.
- Collaborate with leading experts in AI and healthcare analytics.
- Contribute to impactful solutions in the healthcare domain.