Sr. Analyst, System Testing II

About the Role

The Cloud Senior Test Analyst will support the TPA Cloud Migration team, focusing on migrating applications to the CMS AWS Cloud. This role involves a mix of administrative, leadership, and technical testing activities in a fast-paced, multi-platform environment that may require 24/7 responsiveness to meet business needs.

Responsibilities

• Complete administrative and lead activities (40%):
  • Attend sessions with customers.
  • Plan and disburse projects to team members.
  • Complete reports, resource planning, and documentation.
  • Develop and refine processes.
• Manage projects to ensure coordination, documentation, reporting, and customer communication requirements are met (40%).
• Mentor and provide guidance to testing staff.
• Perform quality checks across various IT functions to ensure adherence to quality standards, procedures, and methodologies (20%).
• Define and analyze quality assurance metrics such as defects, defect counts, test results, and test status.
• Make recommendations to clients on improving operational workflows.
• Design, develop, and execute test strategies, test cases, and automated scripts for cloud-native, containerized, and legacy applications migrated to AWS Cloud.
• Lead functional, regression, integration, system, failover, and performance testing across multi-tier AWS Cloud environments.
• Identify, track, and manage bugs using TestRail, JIRA/Confluence, or ALM.
• Implement automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub, AWS CodePipeline).
• Conduct REST/SOAP API testing, SQL testing, and test automation.
• Develop and execute test data strategies, version control, defect triage, and test metrics reporting.
• Perform security and compliance testing (HIPAA, FedRAMP, NIST-800).
• Conduct 508/WCAG compliance testing using tools like Burp Suite/OWASP ZAP and WAVE.

Day-to-Day Activities

A typical day involves planning and executing test cases for the TPA portal within the CMS Cloud (built on AWS). The analyst uses TestRail to manage test plans, track execution, and document results, while JIRA is used to log defects and align testing tasks with Agile sprints. Collaboration with developers and business analysts occurs in daily stand-ups, with Confluence used to maintain test documentation, user stories, and release notes. The role includes validating application behavior in cloud environments, supporting compliance testing, and ensuring updates meet CMS security and performance standards before deployment.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field, or 4 years of job-related work experience, or 2 years of job-related experience plus an associate’s degree in a related field.
• 9 years of IT experience, including experience developing test plans and/or test matrices.
• Agile Testing and CI/CD experience.
• Experience testing cloud-hosted applications.
• Experience with testing tools such as Selenium Grid, JUnit, TestNG, Apache JMeter, SoapUI, and Postman.
• Strong knowledge of lift-and-shift, re-platforming, or cloud migration testing.
• Experience with AWS services: EC2, IAM, S3, RDS/Aurora, Lambda, API Gateway, CloudWatch, CloudTrail, and CodeBuild.
• Medicare experience is required.
• USA residency requirement for background screening; contingent personnel who are foreign nationals must have resided in the US for at least three of the last five years.

Skills

Required Skills and Abilities

• Excellent project planning, organization, and management skills.
• Strong analysis skills.
• Thorough understanding of data processing terminology, operations, and architecture for debugging application/environmental problems.
• Skilled in negotiation and/or influencing business or technical partners.
• Ability to write complex test cases/scripts.
• Excellent written and verbal communication skills.
• Ability to document complex problems and assist in their resolution.
• Ability to understand functional connections between applications.
• Ability to utilize test requirements, specifications, diagrams, and logic functions.

Required Software and Tools

• Standard office equipment.

Preferred Skills and Abilities

• Thorough knowledge of JAVA, Websphere, Windows, and other middleware platforms.
• Knowledge of DB2, Oracle, IMS, and VSAM.
• Skill in whitebox testing, integration testing, static testing, and 508 compliance testing using JAWS software.

Schedule

• Hours: 8:30 a.m. to 5 p.m., with possible overtime to meet project timelines.
• Onsite is highly preferred; partial and remote candidates will be considered.
• Interviews: Onsite for local/partial candidates; remote for non-local candidates.