Content Moderator - 2 Month Contract
Innodata Inc. · United States · 3 wk ago
RemoteRemoteManagement$25/hrContract
About the role
Innodata is a global data engineering company focused on enabling responsible AI advancement through data, evaluation frameworks, and human expertise. We are seeking detail‑oriented Content & LLM Evaluation Annotators to review public social media content and apply complex classification taxonomies consistently across text, images, carousels, and video.
Responsibilities
- Review individual social media posts in their entirety, including captions, images, carousels, video, overlaid text, emojis, hashtags, logos, packaging, and spoken content.
- Watch/review videos according to the prescribed sampling protocol.
- Apply detailed classification taxonomies covering potentially problematic content, including mature themes, body‑focused content, suffering and distress, risky behavior, violence, social aggression, and other defined categories.
- Identify signals associated with suspected branded content.
- Complete reviewability checks and use the appropriate rejection or escalation path when content cannot be accurately assessed.
- Apply multi‑select labeling rules precisely, including rules governing mutually exclusive or non‑combinable labels.
- Distinguish between similar concepts based on the written specification rather than personal interpretation or assumptions.
Requirements
- Bachelor's degree.
- Previous experience in content annotation, content moderation, data labeling, measurement, research labeling, integrity operations, ads review, or ML training‑data programs.
- Experience evaluating or analyzing LLM outputs, including model reasoning or failure modes.
- Excellent critical‑thinking and judgment skills, particularly when content falls into ambiguous or borderline categories.
- Strong attention to detail across both text and multimedia content.
- Ability to distinguish meaningful contextual signals from superficial indicators—for example, understanding that a visual element may need to be both sufficiently visible and a focus of the content to meet a particular classification.
- Ability to recognize commercial intent without assuming that a tag, logo, mention, or positive statement alone constitutes branded content.
- Comfort working with ambiguous, sensitive, graphic, and distressing material.
Pay
The expected hourly salary range for this position is $25 per hour, based on experience, skills, and qualifications.