Business Analyst: US Raters
Weekday AI (YC W21) · United States · 5 days ago
RemoteRemoteOTHRContract
This role is for one of our clients We are looking for detail-oriented and analytical Business Analysts - US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, assessing their quality against predefined criteria, conducting structured evaluations, and providing accurate, well-supported final judgments. The ideal candidate will have at least three years of experience in business analysis or a related field, strong analytical and communication skills, and the ability to evaluate information objectively. This is a fully remote, short-term contract opportunity for candidates based in the United States who can commit to the required working hours and project schedule. Job Details Role: Business Analyst - US RatersExperience: 3+ yearsLocation: United States onlyEmployment Type: Short-term contractContract Duration: 16 weeksCompensation: USD 30 per hourStart Date: ImmediateWork Mode: Fully remoteAvailability: Full-time commitment of 8 hours per dayTime Zone Requirement: At least 4 hours of overlap with US Pacific Time (PST)Work Schedule: Five working days per week, including weekends as required, with two weekdays off Requirements Key Responsibilities Review, analyze, and compare responses generated by multiple AI chatbotsEvaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall qualityGather, analyze, and document business requirements and translate them into clear evaluation guidelinesConduct structured assessments and provide objective, evidence-based judgmentsAnalyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvementPrepare reports, summaries, and supporting documentation to communicate evaluation findingsCollaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questionsTrack task progress, quality metrics, and deliverables to ensure timely completionIdentify recurring issues in chatbot responses and share actionable observationsMaintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project Required Qualifications And Skills Bachelor's degree in Business Administration, Finance, Computer Science, or a related fieldAt least 3 years of experience as a Business Analyst or in a similar analytical roleStrong analytical thinking, problem-solving, and decision-making skillsExcellent written and verbal communication skillsProficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical toolsExperience with requirement gathering, process mapping, and business documentationAbility to work effectively with cross-functional teams and manage multiple prioritiesStrong attention to detail and the ability to make consistent, objective assessmentsFamiliarity with Agile or Scrum methodologies is an advantageAbility to follow detailed instructions, meet deadlines, and work independently in a remote environment Engagement Benefits Opportunity to contribute to projects focused on AI evaluation and chatbot response qualityFully remote work arrangementExposure to structured AI assessment and quality assurance processesOpportunity to work on projects with broader business and technological applicationsClearly defined contract duration, hourly compensation, and project expectations Important Engagement Details This is a project-based contract with a duration of 16 weeksAssigned tasks will involve comparing responses from multiple chatbots and submitting a final assessment based on defined criteriaCandidates must be available for 8 hours per day, five days per weekA minimum of four hours of overlap with US Pacific Time is requiredThe schedule may include weekend work, with two weekdays off each weekCandidates must be based in the United States and comply with the applicable country-specific eligibility guidelinesConsistent evaluation quality, adherence to project instructions, and timely task completion are essential