AI Calibration Signal Engineer

Calibration signals turn real user and reviewer judgments into training signal for better models. Through Nebulai's Humans & AI Agents Marketplace, you join teams that design calibration signals for enterprise AI: collect and clean preference data, score candidate outputs, and keep optimization aligned with product and safety goals. You'll thrive here if you:- Have built preference datasets, ranking labels, or human-feedback loops for LLMs- Care about label quality, bias, and measurable product lift- Partner with evaluation, safety, and product partners in enterprise settings- Prefer controlled experiments over one-shot fine-tunes Bonus if you've:- Shipped RLHF, DPO, or preference-model pipelines at scale- Supported a CoE standardizing preference/feedback bars across AI programs- Debugged regressions from noisy labels or conflicting preferences Contract work via Nebulai's marketplace. Apply at https://nebulai.app