Architecture & Design QA Lead - Remote

About the role

This role is a remote contractor position within a fast-growing AI Data Services company. The company delivers training data for major AI companies and foundation-model labs, aiming to improve the quality of AI models through accurate, context-aware, and practical architecture and design training data.

Responsibilities

• Spot-check architecture/design items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
• Evaluate AI-generated architecture/design explanations, spatial layouts, design concepts, material recommendations, building-system descriptions, accessibility considerations, and design reasoning for accuracy and practicality.
• Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and architecture/design-specific review standards.
• Respond to trainer/QA questions clearly and promptly, especially around spatial logic, design terminology, accessibility, sustainability, construction feasibility, materials, and rubric interpretation.
• DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed.
• Create and maintain architecture/design project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
• Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and architecture/design-specific review requirements.
• Ensure all trainers and QAs apply architecture/design review guidelines consistently and understand updates as projects evolve.
• Flag unsafe, inaccessible, impractical, misleading, code-insensitive, or poorly contextualized architecture/design recommendations.
• Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for architecture/design AI training projects.

Requirements

• Bachelor’s, Master’s, or professional degree in Architecture, Interior Design, Urban Design, Landscape Architecture, Environmental Design, Industrial Design, Planning, or a closely related field.
• A strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear written feedback.
• At least 3 years of experience in architecture, design, interiors, urban design, design research, construction documentation, teaching, design review, visualization, or related built-environment workflows.
• A strong understanding of design principles, spatial organization, circulation, scale, proportion, materiality, accessibility, sustainability, building systems, construction logic, and design communication.
• The ability to evaluate architecture/design content against detailed rubrics and identify issues such as impractical layouts, poor spatial reasoning, code-insensitive suggestions, weak design rationale, accessibility gaps, unsafe assumptions, or unrealistic construction recommendations.
• Familiarity with tools or methods such as AutoCAD, Revit, Rhino, SketchUp, Adobe Creative Suite, BIM, construction drawings, precedent analysis, site analysis, rendering, or design presentations is preferred.
• Experience leading or supporting remote teams of designers, reviewers, annotators, educators, visual QA specialists, or domain experts is strongly preferred.
• Comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• A highly detail-oriented and organized individual with the ability to maintain style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
• Experience with AI training, data annotation, LLM evaluation, design QA, visual review, architectural review, or rubric-based review is a strong plus.

Qualifications

• Strong communication skills, both written and verbal, to communicate with teams and provide clear feedback.
• Excellent attention to detail and organizational skills to maintain style guides, trackers, and documentation.
• The ability to manage quality workflows across remote expert teams.