Psychology and Counseling Expert - AI Conversation Evaluation

About the role

Remote contractor position for a psychology and counseling expert to review AI conversations involving interpersonal, advisory, and decision-making scenarios.

Requirements

• MSW with LCSW or equivalent social-work license OR MA/MS with LMFT, LPC, LCPC or equivalent counseling license OR PhD/PsyD in Clinical, Counseling, Social, or I-O Psychology OR MA/PhD in HCI, Communication, Anthropology, Sociology, Conflict Resolution, Qualitative Research
• At least 3 years relevant professional practice (5+ preferred)
• Experience gathering missing context through interviews, assessments, consultations
• Strong written English and qualitative analytical skills
• Strong attention to detail
• At least 4 hours PST overlap required

Responsibilities

• Review AI conversations involving interpersonal, advisory, and decision-making scenarios
• Assess whether AI gathered sufficient context before recommendations
• Identify missing information and suggest follow-up questions
• Distinguish between load-bearing and non-essential details
• Conduct structured qualitative reviews using evaluation guidelines
• Document findings in spreadsheets, annotation tools, or labeling platforms
• Collaborate with research and quality teams
• Participate in calibration and quality-review activities

Employer: Gramian Consulting Group
Location: Cairo, Egypt (Remote: Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Turkey, Vietnam)
Type: Contractor, Full-Time (40 hrs/week)
Duration: 9 weeks
Short online test required.

Apply here