R Quality Assurance Lead - Remote

About the role

This is an hourly, remote contractor role as an R Quality Assurance Lead at a fast-growing AI Data Services company. The role involves overseeing quality, consistency, and trainer performance across R programming and data-analysis AI training projects.

Responsibilities

• Review AI-generated R code and trainer/QA work, evaluating output quality against project guidelines and providing precise written feedback.
• Evaluate code for correctness, statistical validity, data reasoning, package usage, reproducibility, debugging accuracy, readability, visualization quality, formatting, instruction-following, and rubric adherence.
• Communicate project updates and R-specific standards on Discord.
• Answer trainer/QA questions around R syntax, packages, statistical reasoning, reproducibility, plots, and rubric interpretation.
• Create and maintain R documentation, style guides, examples, trackers, FAQs, honeypots, and onboarding materials.
• Run onboarding/training calls for R contributors.
• Flag misleading statistical claims, invalid methods, non-reproducible workflows, or hallucinated packages/functions.
• Improve QA processes based on recurring gaps.

Requirements

• Bachelor’s or Master’s degree in Statistics, Data Science, Mathematics, Computer Science, Economics, Biology, Social Sciences, or related quantitative field.
• Strong grasp of English to follow guidelines and provide clear feedback.
• 3+ years of experience using R for data analysis, statistics, research, analytics, teaching, coding, or technical review.
• Strong understanding of R syntax, data frames, vectors, functions, lists, factors, missing data, tidyverse, base R, statistical modeling, and visualization.
• Ability to identify issues such as incorrect statistical assumptions, invalid package usage, non-reproducible code, data leakage, flawed transformations, hallucinated functions, or misleading charts.
• Familiarity with dplyr, tidyr, ggplot2, readr, stringr, purrr, data.table, Shiny, R Markdown/Quarto, caret/tidymodels, lme4, survival, Git, and reproducible workflows is preferred.
• Experience leading remote teams of trainers, analysts, reviewers, educators, or QAs is strongly preferred.
• Comfortable with Discord, Google Sheets, Google Docs, trackers, dashboards, GitHub, and PM systems.
• Highly organized and able to maintain style guides, trackers, FAQs, honeypots, calibration tasks, and onboarding materials.
• Experience with AI training, data annotation, LLM evaluation, code QA, or rubric-based review is a strong plus.