Quality Engineer III (AI and ML Platforms)

PURPOSE OF JOB

The Quality Engineer for AI and ML Platforms establishes and evolves quality engineering practices for cloud-native and AI/ML platform solutions, ensuring reliability, scalability, and reproducibility across data, model, and infrastructure layers. The position serves as a key contributor in defining test strategies for distributed systems, data pipelines, and machine learning workflows within AWS and Snowflake environments.

Essential Duties And Responsibilities

• Executes tasks that span across multiple systems/processes for one or more business projects/areas.
• Reviews, analyzes, and evaluates business and IT systems and user needs to determine the best test approach.
• Estimates, prioritizes, plans, and coordinates test activities.
• Identifies, records, thoroughly documents, and tracks bugs.
• PARTNERS WITH THE DEVELOPMENT TEAM TO PERFORM TEST VIA STANDARDS BASED ON APIs FOR COMMUNICATING BETWEEN APPLICATIONS.
• Tracks quality assurance metrics including reporting on pre-defined KPI, defect densities, and open defects counts.
• Influences quality engineering best practices within the scrum team.
• Executes and maintains automated regression test suites using open source tools.
• FOLLOWS STANDARDS IN ACCORDANCE WITH COMPANY POLICY AND REGULATION (MAR, HIPAA, ISO 2700, ISO 27001, ETC.).
• RECOMMENDS PROCESS IMPROVEMENT AND STRONGS THE QUALITY STANDARDS AND IMPLEMENTS THOSE IMPROVEMENTS ON APPROVAL.
• AUDITS TEST DELIVERABLES TO ENSURE THEY MEET STANDARDS AND TAKES CORRECTIVE ACTION TO MITIGATE VARIANCES.
• LEADS THE QE EFFORTS FOR LARGE INITIATIVES AND COLLABORATES CLOSER WITH EXTERNAL VENDOR PARTNERS (OFFSHORE, NEARSHORE) FOR WORK ASSIGNMENTS, STATUS CALLS, WORKING SESSIONS, TRIAGE CALLS ETC.
• DEVELOPS DETAILED, COMPREHENSIVE, AND WELL-STRUCTURED TEST PLANS AND TEST CASES.
• DEVELOPS, PUBLISHES, AND IMPLEMENTS TEST STRATEGY, TEST PLANS, AND TEST SCRIPTS.
• DEVELOPS AND MAINTAINS TESTING PROCESSES TO NEW AND EXISTING PRODUCTS TO MEET STAKEHOLDER NEEDS.
• DEVELOPS AND MAINTAINS TESTING STANDARDS, PROCEDURES, AND GUIDELINES TO ENSURE CONSISTENT TESTING PROCEDURES.
• CREATES TESTS THAT COVER FUNCTIONALITY, LOAD, SECURITY, ETC. AT THE API AND GUI LEVELS.
• IDENTIFIES RISKS AND DEVELOPS MITIGATION STRATEGIES.
• BECOMES A SUBJECT MATTER EXPERT FOR ONE OR MORE BUSINESS AREAS AND TECHNICAL PRODUCT.
• DELIVERS QUALITY PROCESS TRAINING TO TECHNICAL STAFF.
• ACTS AS AN INTERNAL QUALITY CONSULTANT TO ADVISE OR INFLUENCE BUSINESS OR TECHNICAL PARTNERS.
• PERFORMS QUALITY AUDITS ACROSS THE VARIOUS IT FUNCTIONS TO ENSURE THAT QUALITY STANDARDS, PROCEDURES, AND METHODOLOGIES ARE BEING FOLLOWED.
• PARTNERS WITH DISTRIBUTED TEAMS, OUTSIDE VENDORS, OR OFFSHORE TESTING PARTNERS.
• COACHES AND EDUCATES OTHERS TO INCREASE EARLY DEFECT DETECTION RATES AND DECREASE DEFECT ESCAPE RATES.
• DEFINES AND IMPLEMENTS QUALITY STRATEGIES FOR CLOUD-NATIVE AI AND ML PLATFORMS.
• PARTNERS WITH DATA SCIENTISTS AND ML ENGINEERS TO DESIGN AND EXECUTE TESTING STRATEGIES FOR AI/ML APPLICATIONS AND PIPELINES, INCLUDING PIPELINE VALIDATION, DATA VALIDATION, FEATURE AND MODEL VALIDATION, INFERENCE TESTING, INTEGRATION AND API TESTING.
• IMPLEMENT TESTING STRATEGIES FOR INFRASTRUCTURE AS CODE (IaC), INCLUDING VALIDATION OF AWS RESOURCES PROVISIONED VIA TOOLS SUCH AS TERRAFORM OR CLOUDFORMATION.
• ESTABLISHES AUTOMATED QUALITY GATES WITHIN CI/CD PIPELINES TO ENFORCE TESTING STANDARDS ACROSS BUILD, DEPLOY, AND RELEASE STAGES.
• DEFINES OBSERVABILITY AND QUALITY SIGNALS, INCLUDING LOGS, METRICS, AND TRACES, TO PROACTIVELY DETECT DEFECTS IN PRODUCTION SYSTEMS.
• CONTRIBUTES HANDS-ON TO DEBUGGING AND ROOT CAUSE ANALYSIS ACROSS APPLICATION, DATA, AND PLATFORM LAYERS.
• LEADS VALIDATION OF NON-FUNCTIONAL REQUIREMENTS INCLUDING PERFORMANCE, SCALABILITY, RELIABILITY, AND RESILIENCE OF AI AND ML PLATFORMS.
• SUPERVISORY RESPONSIBILITIES: THIS ROLE DOES NOT HAVE DIRECT REPORTS BUT MAY MENTOR AND/OR TRAIN LESS EXPERIENCED TEAM MEMBERS.

  Education And Experience

  • Bachelor’s degree from four-year college or university IN Computer Science, Information Systems or related field, or equivalent work experience.
  • Minimum 4 years of related experience.
  • Minimum 5 years of IT and/or relevant business experience.

  CERTIFICATIONS, LICENSES, REGISTRATIONS

  • Certificated Software Test Engineer (CSTE) or International Software Testing Qualification Board (ISTQB) preferred.
  • CP-SAT Selenium Automation Testing certification preferred.
  • Foundation level API certification preferred.

  Knowledge And Skills

  • Ability to anticipate user behavior or risks to systems; ability to work independently; experience querying and using data to enhance testing approach/scope.
  • Ability to quickly understand and gain domain expertise with complex existing applications and architecture.
  • Ability to validate data transformations and perform End-to-End validations for ETL/ API enabled integrated systems.
  • Experience in analyzing requirements to reduce ambiguity and increase testability; experience developing and reviewing test plans, test cases, and test scripts.
  • Experience mentoring junior (less experienced) QE team members.
  • Knowledge of Insurance Industry best practices and business workflows a plus, and Industry standard certification in Quality Assurance is strongly desired.

  Physical Requirements

  • This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines.
  • Occasionally the work environment may be loud.

  WORK ENVIRONMENT

  • This position operates in an office environment and requires the frequent use of computer, telephone, copier and other standard office equipment.