R Quality Assurance Lead - Remote
YO IT Consulting · New York, United States · 2 wk ago
RemoteRemoteQuality AssuranceFull-time
About the role
This role is a fast-growing AI Data Services company delivering training data for many of the world’s largest AI companies and foundation-model labs. Your R quality leadership will help ensure R training data is accurate, reproducible, statistically sound, clearly explained, and aligned with client expectations.
Responsibilities
- Spot-check R programming and data-analysis items.
- Review AI-generated R code, statistical explanations, visualizations, data-wrangling steps, and modeling workflows.
- Communicate project updates and R-specific standards on Discord.
- Answer trainer/QA questions around R syntax, packages, statistical reasoning, reproducibility, plots, and rubric interpretation.
- DM inactive contributors and manage activation tracking.
- Create and maintain R documentation, style guides, examples, trackers, FAQs, honeypots, and onboarding materials.
- Run onboarding/training calls for R contributors.
- Flag misleading statistical claims, invalid methods, non-reproducible workflows, or hallucinated packages/functions.
- Improve QA processes based on recurring gaps.
Requirements
- Bachelor’s or Master’s degree in Statistics, Data Science, Mathematics, Computer Science, Economics, Biology, Social Sciences, or related quantitative field.
- Strong grasp of English to follow guidelines and provide clear feedback.
- 3+ years of experience using R for data analysis, statistics, research, analytics, teaching, coding, or technical review.
- Strong understanding of R syntax, data frames, vectors, functions, lists, factors, missing data, tidyverse, base R, statistical modeling, and visualization.
- Ability to identify issues such as incorrect statistical assumptions, invalid package usage, non-reproducible code, data leakage, flawed transformations, hallucinated functions, or misleading charts.
- Familiarity with dplyr, tidyr, ggplot2, readr, stringr, purrr, data.table, Shiny, R Markdown/Quarto, caret/tidymodels, lme4, survival, Git, and reproducible workflows is preferred.
- Experience leading remote teams of trainers, analysts, reviewers, educators, or QAs is strongly preferred.
- Comfortable with Discord, Google Sheets, Google Docs, trackers, dashboards, GitHub, and PM systems.
- Highly organized and able to maintain style guides, trackers, FAQs, honeypots, calibration tasks, and onboarding materials.
- Experience with AI training, data annotation, LLM evaluation, code QA, or rubric-based review is a strong plus.