AI Annotation Quality Reviewer

About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. About The Role We are seeking a detail-oriented QA Review Team Lead to oversee quality assurance activities for AI training data and ensure annotated outputs are accurate, consistent, and delivered on time. In this role, you will lead QA reviewers, manage audit and review queues, assess annotation quality, identify recurring errors, and provide clear, actionable feedback to improve team performance. You will also train new reviewers, clarify guidelines for annotators, and escalate complex or recurring issues to the Senior QA Lead. The ideal candidate combines strong quality assurance skills with experience mentoring team members and applying detailed guidelines in a fast-paced environment. Key Responsibilities Lead QA reviewers and manage audit and review queues to ensure timely and accurate completion of assigned workSpot-check annotated data and reviewer decisions to verify compliance with project guidelines and quality standardsProvide clear, actionable, and consistent feedback to reviewers and annotatorsConduct office hours and clarify annotation guidelines, review criteria, and quality expectationsMonitor quality scores, error trends, audit results, and reviewer performanceTrain and onboard new reviewers on project guidelines, tools, and review proceduresIdentify recurring errors, inconsistencies, and process gaps, and recommend corrective actionsEscalate persistent quality issues, unclear guidelines, and complex cases to the Senior QA LeadSupport continuous improvement of review processes and maintain consistent quality across the team Requirements 3-5 years of overall professional experience, including at least 1 year of experience leading, mentoring, or supervising reviewers or team membersStrong attention to detail and the ability to apply complex guidelines consistentlyExcellent written and verbal communication skillsAbility to provide constructive, actionable feedback and explain quality expectations clearlyStrong organizational skills and the ability to manage multiple review queues and competing deadlinesAbility to identify patterns in errors and support corrective actionsAvailability to work the specified schedule for the full 16-week project