AI Tester / AI QA Analyst

About the role

MCI is seeking an AI Tester / AI QA Analyst to join our dynamic team. This role plays a crucial part in ensuring the quality and reliability of AI-powered products, machine learning models, and Generative AI applications.

Responsibilities

• Ensure AI systems perform as expected across multiple use cases.
• Design and execute AI testing strategies and test cases.
• Validate model outputs against expected outcomes.
• Assess system reliability, consistency, and performance.
• Identify defects, anomalies, and areas for improvement.
• Support the delivery of high-quality AI solutions.
• Conduct functional, regression, and user acceptance testing.
• Verify compliance with business and regulatory requirements.
• Provide insights into AI system effectiveness.
• Analyze testing results and develop reports and recommendations.
• Track quality metrics and performance indicators.
• Support root cause analysis activities.
• Collaborate with technical and business teams.
• Help advance AI testing practices across the organization.
• Evaluate new AI testing methodologies and tools.
• Recommend enhancements to quality frameworks.
• Stay informed about AI and Generative AI developments.
• Contribute to best practices and standards.

Requirements

• Bachelor's Degree in Information Technology, Computer Science, Quality Assurance, Engineering, or a related field.
• Minimum 3 years of software testing, QA, or technology-related experience.
• Experience creating and executing test plans and test cases.
• Strong analytical and troubleshooting skills.
• Experience documenting defects and test outcomes.
• Understanding of software development lifecycle methodologies.
• Familiarity with AI, machine learning, or Generative AI concepts.
• Strong attention to detail.
• Ability to analyze large volumes of information and identify patterns.
• Strong written and verbal communication skills.
• Experience working within Agile environments.
• Ability to collaborate effectively with technical teams.

Qualifications

• Nice to have:
• Experience testing AI or machine learning solutions.
• Knowledge of chatbot testing and conversational AI evaluation.
• Experience with QA automation tools.
• Familiarity with prompt engineering concepts.
• Understanding of AI governance and compliance requirements.
• Experience within SaaS, technology, or BPO environments.
• Certifications in software testing or quality assurance.
• Exposure to AI evaluation frameworks.