Senior Software Development Engineer In Test, ML/AI

About the role

Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we're part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.

Responsibilities

• Define and complete quality strategies, test plans, and automation coverage for ML-powered services and platform components.
• Use LLMs and other AI-assisted techniques to generate, expand, and maintain high-value test cases for ML-powered workflows.
• Design scenario-based test suites for AI features, including adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.
• Lead QE efforts for multi-functional projects, driving risk assessment, dependency management, and release readiness.
• Partner with engineering and ML teams to integrate automated testing into CI/CD pipelines and release workflows.
• Collaborate across teams to establish scalable quality standards, tooling, and guidelines.

Requirements

• Bachelor’s degree in Computer Science or equivalent
• 5+ years of experience as an SDET or QE engineer focused on backend and distributed systems
• Experience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences
• Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows
• Strong experience testing RESTful APIs, microservices, and distributed architectures
• Proficiency in Python, Java, JS or similar languages for automation development
• Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium
• Experience with CI/CD systems and test pipelines (Jenkins, GitHub Actions, etc.)
• Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker)
• Familiarity with databases, monitoring, and observability tools
• Strong understanding of SDLC, Agile methodologies, and release processes
• Excellent problem-solving, debugging, and communication skills

Qualifications

• Bachelor’s degree in Computer Science or equivalent
• 5+ years of experience as an SDET or QE engineer focused on backend and distributed systems
• Experience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences
• Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows
• Strong experience testing RESTful APIs, microservices, and distributed architectures
• Proficiency in Python, Java, JS or similar languages for automation development
• Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium
• Experience with CI/CD systems and test pipelines (Jenkins, GitHub Actions, etc.)
• Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker)
• Familiarity with databases, monitoring, and observability tools
• Strong understanding of SDLC, Agile methodologies, and release processes
• Excellent problem-solving, debugging, and communication skills

Skills

• Strong combination of automation engineering and delivery ownership
• Ability to drive quality across complex cross-functional initiatives
• Practical understanding of how to test non-deterministic AI systems and separate model variance from quality regressions
• Proven risk management and dependency coordination skills
• Ability to influence engineering teams and promote quality guidelines
• Passion for scalable, reliable, and maintainable automation systems

Benefits

• Base pay range: $183,000—$274,600 USD
• Top-tier benefits package including medical, dental, vision, matching 401(k), paid time off, wellness program and employee discounts for Sony products
• Eligible for bonus package

Pay

The estimated base pay range for this role is listed above.

Schedule

Details on the schedule are not specified in the job posting.