Jobs · Analyst · California

Applied Research Intern

Labelbox · San Francisco Bay Area · 11 mo ago
AnalystInternship

About the role

As an Applied Research intern at Labelbox, you will design, build, and productionize evaluation and post-training systems for frontier LLMs and multimodal models. You’ll own continuous, high-quality evals and benchmarks (reasoning, code, agent/tool-use, long-context, vision-language, et al.), create and curate post-training datasets (human + synthetic), and prototype RLHF/RLAIF/RLVR/RM/DPO-style training loops to measure and improve real-world task and agent performance.

Responsibilities

  • Build and own evaluation and benchmark suites for reasoning, code, agents, long-context, and V/LLMs.
  • Create post-training datasets at scale: design preference/critique pipelines (human + synthetic), and target hard failures surfaced by evals.
  • Experiment and prototype RLHF/RLAIF/RLVR/RM/DPO-style training loops to improve real-world task and agent performance.
  • Land research in product: ship improvements into Labelbox workflows, services, and customer-facing evaluation/quality features; quantify impact with customer and internal metrics.
  • Engage with customer research teams: run pilots, co-design benchmarks, and share practical findings through internal research reports, blog posts, talks, and published papers.

Requirements

A strong foundation in AI and machine learning, backed by a Ph.D. or Master’s degree in Computer Science, Machine Learning, AI, or a related field (in progress degrees are acceptable for intern positions).

A deep understanding of frontier autoregressive and diffusion multimodal models, along with the human and synthetic data strategies needed to optimize them.

Passion and experience for LLM evaluation and benchmarking.

Expertise in training data quality construction, measurement and refinement.

The ability to bridge research and application by interpreting new findings and translating them into functional prototypes.

A track record of publishing in top-tier AI/ML conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP, NAACL) and contributing to the broader research community.

Proficiency in Python and experience with deep learning frameworks like PyTorch, JAX, or TensorFlow.

Exceptional communication and collaboration skills.

Qualifications

None specified.

Skills

Strong foundation in AI and machine learning.

Deep understanding of frontier autoregressive and diffusion multimodal models.

Experience with Python and deep learning frameworks.

Ability to bridge research and application.

Track record of publishing in top-tier AI/ML conferences.

Benefits

Not specified.

Pay

Annual base salary range $35—$45 USD

Schedule

Hybrid model with 3 days per week in office, combining collaboration and flexibility.

Similar jobs

Research Intern

Nationwide Children's HospitalColumbus, OH· 2 mo ago
Analystapply on nationwidechildrens.wd5.myworkdayjobs.com

Research Intern

IntegrityMinneapolis, MN· 1 wk ago
Analystapply on integritymarketing.wd1.myworkdayjobs.com

Research Intern

Quadrillion LabsNew York, NY· 2 wk ago
Analyst$300k–$500k/yrapply on jobs.ashbyhq.com

Research Intern

MixedbreadSan Francisco, CA· 3 wk ago
Information Technologyapply on mixedbread.com

Research Intern

Oakland UniversityRochester, MI· 2 wk ago
Analyst$20/hrapply on jobs.oakland.edu