Product Designer | $80/hr | Remote
About the role
We are seeking experienced product designers, UX/UI designers, design system specialists, AI-assisted developers, rapid prototypers, and AI-native product builders to create realistic evaluation tasks for advanced AI systems. This opportunity spans two tracks: AI-assisted development / Vibecoding and Product Design / UX/UI. Professionals with deep expertise in either track, or experience across both, are encouraged to apply.
Responsibilities
- Create realistic product design and rapid-prototyping scenarios
- Develop tasks involving AI-assisted coding, natural-language-to-code workflows, UX/UI design, design systems, user research, and usability testing
- Build reference prototypes, code artifacts, design specifications, component systems, and usability evaluations
- Design scenarios involving cross-functional collaboration between product, engineering, design, and research teams
- Evaluate whether outputs demonstrate genuine senior-level product judgment
- Create scoring rubrics that distinguish strong professional work from generic templates or tutorial-level solutions
- Apply iterative prototyping, human-centered design, heuristic evaluation, and AI-assisted development methodologies
Qualifications
Relevant backgrounds
- Product Design: Product Designers, Senior Product Designers, Staff Product Designers, Principal Product Designers, Lead Product Designers, UX Designers, UI Designers, UX/UI Designers, Interaction Designers, Experience Designers, Digital Product Designers, Visual Designers, Interface Designers, Web Designers, Mobile Product Designers, Application Designers
- Design Leadership: Design Leads, Design Managers, Product Design Managers, Heads of Design, Design Directors, UX Directors, Creative Directors, Experience Design Directors, Design Principals, Design Consultants
- Design Systems: Design Systems Designers, Design Systems Leads, Design Systems Engineers, UI Systems Designers, Component Library Designers, Design Technologists, UX Engineers, Design Engineers, Frontend Design Engineers, Design Infrastructure Specialists
- Research & Usability: UX Researchers, User Researchers, Product Researchers, Usability Researchers, Human Factors Specialists, Human-Computer Interaction Professionals, HCI Researchers, UX Strategists, Service Designers, Information Architects, Customer Experience Designers
Product Design Experience
- End-to-end product design
- UX and UI design
- User flows and information architecture
- Wireframes and interactive prototypes
- Mobile and web application design
- Design systems and component libraries
- Design tokens and reusable UI patterns
- Responsive and adaptive interface design
- Accessibility and inclusive design
- User research and customer discovery
- Usability testing
- Heuristic evaluation
- Product critique and design review
- Product requirements and design specifications
- Developer handoff and design QA
- Cross-functional product development
- Iterative product discovery and experimentation
AI-Assisted Development Experience
- Prompt-driven application development
- Natural-language-to-code workflows
- Building applications with AI coding assistants
- Rapid creation of functional product prototypes
- Iterating on AI-generated code
- Debugging and refining AI-generated applications
- Translating product requirements into prompts and technical specifications
- Building frontend, backend, API, and database functionality with AI assistance
- Testing and validating generated applications
- Moving AI-generated prototypes toward production quality
- Evaluating where AI-generated code requires human intervention
- Combining design judgment with rapid software development
Requirements
- 5+ years of professional experience in product design, UX/UI, design engineering, AI-assisted development, product engineering, or a related discipline
- Direct ownership of meaningful products, prototypes, design systems, or development workflows
- Strong understanding of real-world product development and iterative design
- Ability to evaluate whether a product solution actually addresses user and business needs
- Experience collaborating across product, design, engineering, or research teams
- Strong written communication and ability to explain design or technical decisions clearly
- Ability to create structured reference work and evaluate quality consistently
Preferred Background
- Portfolio demonstrating shipped products, applications, interfaces, or design systems
- Experience at a product-led technology company, design-forward organization, startup, or independent product studio
- Experience building and shipping products using AI coding assistants
- Experience owning large-scale design systems or component libraries
- Experience moving rapidly from concept to functional prototype
- Strong understanding of both UX principles and technical implementation
- Experience reviewing or critiquing the work of designers or engineers
- Experience creating product design standards, training materials, design critiques, or evaluation frameworks
- Prior work involving AI evaluation, benchmark creation, human feedback, or structured quality assessment
A formal credential is not required. A strong portfolio of shipped work, real product ownership, and demonstrated senior-level judgment are highly valued. This opportunity is ideal for experienced product builders who understand both the craft of creating excellent user experiences and the rapidly evolving workflows of AI-assisted product development.