Senior SDET (healthcare, Gen AI, AWS)

About the role

We are seeking a Senior SDET/Automation Engineer with mandatory healthcare claims industry experience and deep expertise in testing AI/ML and Generative AI systems, including LLMs, RAG implementations, and prompt engineering. The role requires strong AWS skills (SageMaker, Bedrock), Salesforce ecosystem knowledge, and SQL/automation proficiency to drive quality assurance during a Snowflake-to-AWS migration.

Responsibilities

• Validate AI/ML and Generative AI systems, including testing LLM outputs, prompts, and RAG implementations.
• Develop test strategies for AI/ML models, addressing challenges such as model drift, hallucination detection, and bias evaluation.
• Write complex SQL queries and build automation frameworks using Selenium/BDD.
• Work hands-on with cloud platforms, specifically AWS (SageMaker, Bedrock), Databricks, and Snowflake.
• Integrate and test within the Salesforce ecosystem.
• Collaborate with cross-functional teams to monitor chatbots and ensure quality delivery throughout the Snowflake-to-AWS migration.
• Clearly articulate AI testing findings to diverse stakeholders and adapt to evolving Gen AI tools.

Requirements

• SDET / Automation Engineering experience
• Prompt Engineering, AI/ML, Generative AI expertise
• AI Test Automation and AI Test Solutions design
• AWS Bedrock, Databricks, Snowflake
• CloudBees, Jenkins (CI/CD)
• Salesforce platform experience
• Healthcare Claims Systems domain knowledge
• Strong SQL and automation scripting skills

Location & Schedule

Hybrid role based in Columbia, MD — on-site once or twice per month. Candidates must reside in VA, MD, DC, or nearby states.

Duration

6+ months contract.