Manufacturing AI Training Specialist — Task Creation & Model Evaluation (Contract)
About the role
Rise Data Labs is a leading AI training and data annotation company specializing in creating high-quality training data for artificial intelligence systems. Our team works with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. We focus on various fields including manufacturing, engineering, operations, and supply chain.
Responsibilities
- Author realistic task scenarios drawn from your own professional experience — e.g., analyzing production data, building cost or capacity models, evaluating supplier quotes, or reviewing technical specs
- Supply the kinds of reference materials you'd use on the job (spreadsheets, CAD/engineering files, procurement documents)
- Write detailed rubrics defining what a correct, high-quality deliverable requires — specific calculations, formatting, and structure a client would expect
- Grade AI-generated deliverables (often Excel models or technical documents) against your rubric and professional judgment
- Participate in calibration sessions with other experts to align scoring standards across the benchmark
Requirements
- Bachelor's or Master's degree in Industrial Engineering, Mechanical Engineering, Operations, or a related field
- Prior hands-on experience in manufacturing operations, production management, or supply chain/procurement
- Comfort working in Excel-heavy workflows (cost models, BOMs, capacity planning)
- Prior experience with AI model training, evaluation, or benchmark development is a plus
Qualifications
Preferred qualifications include:
- Comfort working in Excel-heavy workflows (cost models, BOMs, capacity planning)
- Prior experience with AI model training, evaluation, or benchmark development
Skills
- Expertise in manufacturing processes and operations
- Strong analytical and problem-solving skills
- Proficiency in Excel and other spreadsheet tools
- Ability to write clear and detailed rubrics
- Experience with AI model evaluation and benchmarking
Benefits
We offer a supportive and flexible working environment, opportunities for professional development, and the chance to work on innovative projects that directly impact the future of AI in manufacturing and industrial work.
Pay
Competitive salary based on experience and qualifications.
Schedule
Flexible remote schedule to accommodate your needs.