STEM Degree Jobs in Canada

About The Role

Join Rex.zone in a remote, full-time engineering role supporting end-to-end AI/ML workflows that convert raw data into reliable training datasets and evaluation signals for LLM training pipelines. You will help improve training data quality, annotation guidelines compliance, and large language model evaluation outcomes through structured QA evaluation and audits.

Key Responsibilities

• Design and execute workflow checks for QA evaluation, audit sampling, and calibration agreement
• Implement or improve data pipelines for labeled datasets and dataset versioning
• Perform RLHF preference ranking and rubric-based prompt evaluation
• Validate annotation guidelines compliance via sampling, adjudication, and reviewer feedback loops
• Support NLP labeling such as named entity recognition and text classification
• Support computer vision annotation (boxes, polygons, keypoints, segmentation) as needed
• Execute content safety labeling with consistent taxonomy, escalation, and documentation
• Document edge cases, decisions, and dataset versions for reproducible delivery

Required Qualifications

• STEM degree or equivalent practical experience
• Mid-senior experience delivering production-quality work in software or data-centric workflows
• Ability to follow and improve detailed rubrics and operate with measurable quality thresholds
• Familiarity with AI/ML concepts and evaluation methods for model performance improvement

Remote Work and Collaboration

This is a Remote, FULL_TIME role with written-first collaboration using specs, tickets, and review feedback loops. Apply via Rex.zone with a resume highlighting engineering delivery, QA practices, and any AI/ML evaluation or labeling experience.