Content Automation Specialist

Overview

We are seeking a highly technical and strategic Content Automation Specialist to transform how content quality is validated across Microsoft 365 and Copilot experiences.

Responsibilities

• Design scalable evaluation systems, automated testing workflows, and AI-assisted quality frameworks that increase efficiency while maintaining human-centered quality standards.
• Understand where automation can replace manual review, where human evaluation remains critical, and how to build systems that continuously improve content quality at scale.
• Partner with cross-functional teams to define testing strategies, build evaluation frameworks, develop automation opportunities, and shape the future of content quality operations.
• Create recommendations for balancing automation, AI evaluation, and human review.
• Develop and implement automated testing workflows and validation systems.
• Build tools and processes that reduce manual effort while maintaining content quality.
• Identify opportunities to leverage AI for defect detection, content validation, and quality assurance.
• Design human evaluation programs and human-in-the-loop workflows.
• Analyze testing metrics and operational data to identify improvement opportunities.
• Measure the effectiveness of testing systems and continuously optimize workflows.
• Drive adoption of testing standards and scalable evaluation practices.
• Influence long-term strategy for content quality and AI evaluation programs.

Requirements

• Bachelor's degree in Computer Science, Engineering, Data Science, Information Systems, AI, or related field.
• 2-4 years of experience in test automation, quality engineering, AI evaluation, or systems development.
• Strong experience with Python and automation tooling.
• Experience with Copilot, VSCode, and other AI tooling and infrastructure.
• Experience building testing frameworks, quality systems, or workflow automation solutions.
• Experience interpreting data and translating findings into strategic recommendations.
• Strong technical problem-solving and systems-thinking skills.

Preferred Qualifications

• Experience evaluating generative AI systems or LLM-powered products.
• Familiarity with content quality measurement and content operations.
• Experience working with machine learning, AI quality, or model evaluation frameworks.
• Understanding of Microsoft 365, Copilot, or productivity software ecosystems.
• Experience building internal tools, dashboards, or quality monitoring systems.

Benefits

Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We also offer an ESPP (employee stock purchase program), a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Everforth Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Everforth Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our ‘Welcome Packet’ as well, which an Everforth Apex team member can provide.