SDET / AI Test Automation Engineer | GenAI, LLM & RAG | Healthcare Claims | In-Person Interview

Position Details

Location: DMV Area (Maryland, Washington, DC, and Virginia). Work Arrangement: Hybrid. Interview Process: Two rounds — one virtual and one in-person.

Key Responsibilities

• Design and execute test strategies for AI/ML and Generative AI applications.
• Validate LLM outputs, prompt behavior, RAG pipelines, and AI-generated responses.
• Develop and maintain automated test suites using Selenium, BDD, and other automation tools.
• Perform manual, exploratory, UI, API, and backend testing.
• Write complex SQL queries to validate data across multiple databases, including Oracle.
• Identify and evaluate model drift, AI hallucinations, bias, accuracy, relevance, and output safety.
• Test Salesforce applications integrated with AI/ML capabilities and external LLM services.
• Support quality assurance activities during Snowflake-to-AWS migration.
• Collaborate with developers, data scientists, product owners, and business stakeholders.

Required Skills and Qualifications

• Strong SDET / Software QA / Automation Engineering experience.
• Mandatory healthcare claims industry experience.
• Hands-on experience testing AI/ML and Generative AI applications, including LLMs, RAG, and prompt engineering.
• Experience with AI test automation and validation of AI-generated outputs.
• Strong SQL skills and relational database experience; Oracle knowledge is important.
• Experience with Selenium and BDD automation frameworks.
• Experience testing Salesforce applications and AI-enabled features.
• Knowledge of AWS AI/ML services, particularly SageMaker and Bedrock, or equivalent platforms.
• Exposure to Snowflake, Databricks, Jenkins, or CloudBees is beneficial.
• Familiarity with Agile methodologies, Jira, and Confluence.
• Excellent analytical, communication, and problem-solving skills.
• Bachelor's degree required; a technical degree is preferred.

Ideal Candidate Profile

We are specifically seeking an SDET / Automation Engineer with a strong background in healthcare claims, AI/ML testing, GenAI, LLMs, RAG, prompt engineering, SQL, Salesforce, and test automation.