QA Engineer with AI testing

About the role

We are seeking an experienced professional to test AI applications, RAG systems, agents, APIs, and data pipelines using automated development frameworks.

Responsibilities

• Design end-to-end test plans for generative AI, LLMs, and machine learning models.
• Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
• Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
• Validate training, validation, and test datasets for bias, leakage, and data integrity.
• Evaluate system scalability and response times under heavy concurrent loads.
• Mentor junior engineers and collaborate with data scientists and software developers.

Requirements

• Bachelor’s or master’s degree in computer science or related field.
• Minimum 8 years of experience.
• Primary skill: Test AI applications, RAG systems, agents, APIs, and data pipelines using automated development frameworks.
• Certifications in automation (preferred).