Marketing Expert

Overview

We are seeking experienced marketing and advertising professionals to contribute to a research initiative focused on evaluating how effectively advanced AI systems perform real-world marketing work. In this role, you will use your professional marketing expertise to define what high-quality work looks like. Rather than simply producing marketing deliverables, you will create task-specific evaluation criteria, assess AI-generated and human work samples, and provide rigorous, well-reasoned written justifications for your assessments. Your industry experience will help establish practical standards for evaluating marketing strategy, creative quality, brand thinking, messaging, and campaign development.

Responsibilities

• Develop precise, task-specific grading criteria for real-world marketing deliverables, including: creative briefs; campaign concepts and presentations; brand positioning and messaging frameworks; advertising copy and scripts; integrated marketing campaign plans; and client-ready presentations.
• Evaluate AI-generated and human-produced marketing work against defined criteria and provide detailed written justifications for each assessment.
• Assess whether creative and strategic work effectively addresses the original brief, target audience, brand objectives, and business goals.
• Apply consistent, evidence-based judgment to ensure evaluation results are reproducible and defensible.
• Identify strengths, weaknesses, inconsistencies, and gaps in marketing strategies and creative outputs.
• Incorporate structured feedback from senior reviewers and continuously refine evaluation frameworks.
• Translate practical marketing judgment into clear, structured criteria that can be consistently applied across different projects and deliverables.

Qualifications

• 5+ years of professional experience in marketing, advertising, brand strategy, or a closely related field.
• Experience as a Creative Director, Account Lead, Brand Strategist, Marketing Leader, or similar professional.
• Background at leading global creative agencies or in senior brand/marketing roles at established consumer-facing companies.
• Strong understanding of the day-to-day marketing craft, including: developing and evaluating creative briefs; campaign strategy and development across multiple channels; brand positioning; messaging strategy; creative concept evaluation; and connecting creative work to business objectives.
• Ability to critically evaluate marketing work against a brief, target audience, brand strategy, and measurable business objective.
• Exceptional written communication skills, with the ability to clearly explain why a marketing deliverable meets or falls short of professional standards.
• Highly detail-oriented, consistent, and comfortable having professional judgment reviewed and calibrated against experienced peers.
• Prior experience with AI training, model evaluation, human-data projects, or AI-assisted workflows is a strong plus.
• Specialized experience in media planning, media buying, or marketing measurement is not required for this opportunity.

Pay

$80–$150 per hour.

Schedule

This is a fully remote opportunity with flexible scheduling.