AI Tester - Senior QA Automation Engineer (Selenium & AI Testing)

Key Responsibilities

• Conduct system integration testing for new and enhanced applications.
• Develop and execute automated tests using Selenium and other industry-standard tools.
• Collaborate with project teams to establish plans, standards, and procedures that optimize testing efforts.
• Ensure on-time delivery by monitoring dependencies, progress, and milestones.
• Educate business and development teams on the testing methodology, with a focus on end-to-end quality assurance.
• Lead project and quality management initiatives, including issue tracking and communication.
• Optimize resource utilization by assisting the Testing Manager in reviewing forecasting reports.
• Ensure compliance with Agile methodologies, maintaining detailed process documentation.
• Perform AI-specific testing, including validation of LLMs and RAG architectures using vector databases.
• Implement automated testing frameworks for Gen AI applications, such as DeepEval and RAGAs.
• Develop custom validation scripts for evaluating AI model accuracy, relevance, and faithfulness.
• Test prompt engineering techniques to refine AI-generated responses.
• Execute SQL queries in Snowflake to validate database integrity and application responses.

Essential Skills & Experience

• 6+ years of experience in Software Functional Testing with automation expertise in Selenium.
• Experience with Jira and ALM for test and issue tracking.
• Strong proficiency in Python, with experience in AI testing frameworks such as LangChain, Pytest, and PyTorch.
• Familiarity with LLM & RAG architecture testing using vector databases.
• Familiarity with Snowflake, SQL querying, and data validation techniques.
• Excellent communication and leadership skills to engage with stakeholders.