Jobs · OTHR

Data Science & Quantitative AI Evaluation Specialist

Gramian Consulting · United States · 6 days ago
RemoteRemoteOTHRContract
About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. About The Role We are looking for Data Scientists and Quantitative Professionals to help evaluate and improve next-generation AI models. You will assess AI-generated solutions to problems involving statistics, machine learning, experimentation, and quantitative reasoning. You will also create challenging prompts, datasets, and verified reference solutions while identifying methodological flaws, statistical errors, and weaknesses in analytical reasoning. This role is ideal for candidates with relevant professional experience in technology, finance, or research who can communicate technical concepts clearly. SENIORITY: Junior / Early-Career Professional LANGUAGE: Strong written English LOCATION: Remote — English-speaking countries Key Responsibilities Evaluate AI-generated outputs across data science, statistics, machine learning, experimentation, and quantitative problem-solvingCreate expert-level prompts, datasets, and reference solutions for AI training and evaluationIdentify flawed methodologies, statistical inaccuracies, unsupported assumptions, and weaknesses in quantitative reasoningAssess the correctness, reliability, and clarity of analytical approaches and conclusionsProvide structured, evidence-based feedback to help improve AI model capabilitiesApply consistent evaluation criteria and communicate technical findings clearly Requirements At least one year of professional experience at a recognized company in technology, finance, or research, with some of that experience gained within the past three yearsFoundational knowledge of data science, statistics, machine learning, or quantitative analysisStrong analytical and critical-thinking skills, with the ability to identify errors in data-driven reasoningExcellent written English and the ability to explain technical and statistical concepts clearlyAbility to evaluate complex problems systematically and provide accurate, well-supported feedbackCurrent residence in an English-speaking country

Similar jobs