Senior Test Automation AI Engineer (Automation & Operations) - Vice President - Dallas

Responsibilities

• Autonomous Test Harness Engineering: Design and maintain "self-healing" test frameworks that use AI to automatically update locators and scripts when UI or API schemas change, reducing maintenance toil by up to 70%.
• LLM-Powered Test Generation: Implement agentic workflows (using frameworks like LangGraph or CrewAI) to analyze Jira stories, PR diffs, and system architecture to generate comprehensive test suites, including edge cases and negative scenarios.
• Intelligent Observability & Monitoring: Build telemetry pipelines that use ML for anomaly detection and predictive risk analysis, identifying high-risk code areas before they reach production.
• Synthetic Data Orchestration: Leverage Generative AI to create high-fidelity, privacy-compliant synthetic datasets for complex integration and performance testing.
• "LLM-as-a-Judge" Implementation: Establish automated evaluation frameworks (e.g., Giskard, DeepEval) to measure the accuracy, safety, and hallucination rates of AI-driven features.
• CI/CD Integration: Architect intelligent gates within the CI/CD pipeline that use predictive test selection to run only the most relevant tests for a given code change, optimizing execution speed.
• Cross-Functional Collaboration: Partner with developers and data scientists to ensure "testability" is built into AI models and microservices from the design phase.