Content Automation Specialist [211488]
What You’ll Do
- Design scalable testing and evaluation frameworks for content, templates, and AI-generated experiences.
- Define quality measurement approaches and establish testing standards across diverse content ecosystems.
- Create recommendations for effectively balancing automation, AI evaluation, and essential human review.
- Develop and implement sophisticated automated testing workflows and validation systems.
- Build innovative tools and processes that significantly reduce manual effort while rigorously maintaining content quality.
- Identify and leverage opportunities to integrate AI for enhanced defect detection, content validation, and quality assurance.
- Design robust human-in-the-loop evaluation frameworks for accurately assessing AI outputs.
- Establish clear quality rubrics, comprehensive benchmarking criteria, and effective testing methodologies.
- Strategically determine where human judgment adds measurable value and where automation can efficiently scale operations.
- Analyze complex testing metrics and operational data to pinpoint critical improvement opportunities.
- Develop actionable recommendations that enhance quality, boost efficiency, and expand testing coverage.
- Measure the effectiveness of testing systems and continuously optimize workflows for peak performance.
- Collaborate with cross-functional teams on automation recommendations and thorough evaluations of quality risks.
- Drive the adoption of consistent testing standards and scalable evaluation practices across teams.
- Influence the long-term strategy for content quality and AI evaluation programs, leaving a lasting impact.
Must-Have Qualifications
- Bachelor's degree in Computer Science, Engineering, Data Science, Information Systems, AI, or a related field.
- 2-4 years of experience in test automation, quality engineering, AI evaluation, or systems development.
- Strong experience with Python and various automation tooling.
- Experience with AI tooling and infrastructure.
- Experience building testing frameworks, quality systems, or workflow automation solutions.
- Experience interpreting data and translating findings into strategic recommendations.
- Strong technical problem-solving and systems-thinking skills.
Nice-to-Have Qualifications
- Experience evaluating generative AI systems or large language model (LLM)-powered products.
- Experience designing human evaluation programs or human-in-the-loop workflows.
- Familiarity with content quality measurement and content operations.
- Experience working with machine learning, AI quality, or model evaluation frameworks.
- Understanding of productivity software ecosystems.
- Experience building internal tools, dashboards, or quality monitoring systems.
About Aquent
Aquent connects the best talent in marketing, creative, and design with the world’s biggest brands. Our eligible talent get access to amazing benefits like subsidized health, vision, and dental plans, paid sick leave, and retirement plans with a match. We also offer free online training through Aquent Gymnasium.
Client Description
Join a global technology leader driving innovation and empowering people and organizations worldwide to achieve more. Here, you’ll collaborate with passionate, diverse teams to create impactful solutions that shape the future. The culture prioritizes growth, inclusion, and purpose—where your ideas are valued, and your work drives real change. Wherever your passion lies and wherever your career is headed—you’ll play a role in projects that touch billions of lives. With flexible work options and a supportive environment, you’ll have the tools to thrive both personally and professionally.
Why work with AQUENT?
Check out our awesome benefits: https://aquent.com/talent/talent-benefits
Aquent is an equal opportunity employer.
We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics.