AI Software Test Engineer (SDET) [AQ-19198]

About the role

Partnering with Aquent, we represent a leading organization at the forefront of financial innovation. This institution is dedicated to building secure, reliable, and cutting‑edge solutions that empower millions of users to achieve their financial goals. Join a team that is shaping the future of technology within the financial industry, driving impact through advanced engineering and a commitment to excellence. Are you ready to dive into the exciting world of Artificial Intelligence and make a tangible impact on the next generation of intelligent systems? This pivotal role offers a unique opportunity to spearhead the quality assurance of groundbreaking AI‑powered applications, machine learning systems, AI agents, and generative AI solutions. You will be instrumental in ensuring that our AI systems are not just innovative, but also reliable, safe, accurate, and performant, directly contributing to the trust and success of our advanced technology initiatives and the millions of users we serve. As a critical contributor, you will own the end‑to‑end testing and automation efforts for robust AI solutions, collaborating closely with AI developers, architects, and product teams to guarantee production‑quality AI. This role offers significant opportunities for innovation and collaboration across diverse teams, directly shaping the reliability and success of cutting‑edge AI technologies that meet stringent quality, security, and governance requirements.

Responsibilities

• Develop and implement comprehensive testing strategies for AI applications, platforms, and services.
• Validate AI model outputs for accuracy, consistency, reliability, and safety, performing adversarial, negative, and edge‑case testing to identify potential failures and hallucinations.
• Design and execute functional, integration, end‑to‑end, regression, and performance tests specifically tailored for AI solutions.
• Create intricate test cases for prompt‑driven, agentic, and retrieval‑based AI workflows, ensuring robust validation of AI guardrails, business rules, permissions, and governance controls.
• Build and maintain advanced automated test frameworks and evaluation pipelines for AI responses and workflows, integrating AI testing seamlessly into continuous integration/continuous delivery (CI/CD) pipelines.
• Implement automated quality scoring and regression detection mechanisms, and create reusable test data, mocks, simulators, and validation frameworks.
• Test AI agents, workflows, APIs, complex system integrations, and tool‑calling capabilities, validating integrations with external systems, data sources, and enterprise services.
• Verify performance, reliability, scalability, and resiliency of AI workloads, including executing load and stress testing for AI services.
• Collaborate proactively with software engineers, AI engineers, product owners, architects, and security teams, providing critical quality feedback during design reviews and development.
• Contribute significantly to test strategy, quality standards, and best practices, and support production readiness reviews and defect tri