Design Evaluation Expert - Graphic

Role Responsibilities

• Design precise, task-specific grading criteria for real-world design deliverables.
• Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
• Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.
• Collaborate asynchronously and work independently to meet deadlines and improve AI model performance.

Qualifications

• Must have 5+ years of professional experience in graphic, brand, or visual design.
• Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
• Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
• Exceptionally strong written communication skills.
• Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

• Prior experience with AI training, evaluation, or human-data projects.