Quality Analyst (contract)

Job Responsibilities

• Develop and execute test plans for templates, prompt templates, AI-generated content, and other Microsoft 365 content experiences
• Perform manual and automated testing across Word, Excel, PowerPoint, Create, and Copilot experiences
• Validate content quality, functionality, usability, accessibility, and adherence to design fidelity
• Identify, document, reproduce, and track defects through resolution
• Evaluate AI-generated outputs against defined quality standards and acceptance criteria
• Audit content accuracy, relevance, usability, formatting, and overall customer experience
• Create and maintain test scripts, test cases, validation frameworks, and execution documentation
• Develop repeatable testing approaches for new content experiences and features
• Partner with content and cross-team stakeholders to identify opportunities for automation
• Analyze testing results and communicate findings clearly to stakeholders
• Identify patterns, recurring issues, and opportunities for quality improvements
• Track testing outcomes and ensure changes are reflected in documentation and content production workflows

Requirements

• 2–4 years of experience in QA, content testing, usability testing, or quality assurance
• Minimum 2 years of demonstrated experience creating test plans, test cases, and test reporting documentation
• Minimum 2 years of demonstrated experience communicating the outcomes of quality testing work in a content-focused environment
• Hands-on experience scripting in Python, PowerShell, or similar languages within a QA or content testing context
• Bachelor's degree in Content Automation, Computer Science, Engineering, Information Systems, or a related field
• Strong understanding of testing methodologies and quality assurance processes
• Experience scripting in Python, PowerShell, or similar languages
• Knowledge of Microsoft 365 products and productivity workflows
• Excellent analytical and problem-solving skills
• Strong written and verbal communication skills with the ability to convey quality outcomes to diverse stakeholders
• Experience testing AI-generated content or generative AI experiences (preferred)
• Understanding of design principles, content quality, and user experience (preferred)
• Experience working with automation frameworks (preferred)
• Familiarity with human evaluation methodologies and quality rubrics (preferred)