Entry Level AI Jobs in Canada

Key Responsibilities

• Deliver consistent, high-accuracy labels using rubric-based decisioning
• Perform RLHF comparisons and preference judgments to support model performance improvement
• Execute prompt evaluation for helpfulness, harmlessness, and truthfulness
• Complete QA evaluation by reviewing outputs and resolving edge cases
• Apply content safety labeling policies (toxic, self-harm, sexual, violence)
• Annotate NLP datasets (named entity recognition, text classification)
• Annotate computer vision datasets (bounding boxes, segmentation)
• Document rationale and exceptions to strengthen guidelines compliance

Qualifications

• Strong attention to detail and ability to follow detailed guidelines
• Comfort handling ambiguous cases and explaining labeling rationale
• Helpful exposure: data labeling platforms, RLHF, prompt evaluation, NER, CV annotation, content moderation
• Able to work independently in a distributed remote environment