Small Business AI Evaluator - English
Braintrust · United States · 1 wk ago
RemoteRemoteTrainingFull-time
Role Overview
Evaluate and compare the quality of responses from multiple AI chatbots across real-world small business use cases.
Responsibilities
- Create realistic business-related prompts based on defined user goals
- Interact with multiple AI chatbots (max. 5 turns per conversation)
- Assess response quality across clarity, usefulness, and accuracy
- Provide structured feedback and comparative evaluations
- Submit conversation transcripts and evaluation results
Requirements
- Business owner or strong understanding of small business operations
- Strong analytical and critical thinking skills
- Ability to follow structured evaluation guidelines
- Comfortable interacting with AI tools
What You'll Work On
- Create engaging visual content for marketing
- Help answer and evaluate situations related to day-to-day operations and customer interactions
- Conduct market research and contribute ideas in your area of expertise
- Work with data to support analysis and financial planning
- Review and evaluate AI-generated responses for small business use cases
- Use tools and input files such as spreadsheets, PDFs, and images as part of your work
Offer Details
Project-based with defined number of evaluation tasks. Each task includes multi-chatbot comparison and final assessment. Duration: 16 weeks.