Applied Researcher I (AI Foundations)

About the role

The Applied Researcher I (AI Foundations) role at Capital One involves working with a cross-functional team to deliver AI-powered products that enhance customer interactions. This includes leveraging a broad stack of technologies to analyze and interpret large datasets, building foundational AI models, and conducting high-impact applied research to advance customer experiences.

Responsibilities

• Partner with a cross-functional team of data scientists, software engineers, machine learning engineers, and product managers to develop AI-driven products that improve customer engagement.
• Leverage technologies such as PyTorch, AWS Ultraclusters, Huggingface, Lightning, and VectorDBs to uncover insights from extensive data sets.
• Create AI foundation models throughout the development lifecycle, from design to training, evaluation, validation, and deployment.
• Innovate by applying the latest AI advancements to create next-generation customer experiences.
• Communicate complex AI concepts to stakeholders to align with business goals.

Requirements

• Currently pursuing or recently obtained a PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields, or a Master’s degree in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields with 2 years of relevant experience.
• Innovative and creative, with a strong interest in researching and evaluating emerging technologies.
• Able to lead and influence across various teams to drive impactful projects.
• Proficient in open-source languages and experienced in developing AI foundation models using cloud computing platforms.
• Deep understanding of AI methodologies and experience in building large deep learning models.
• Experience in optimizing training and inference processes, as well as in model sparsification, quantization, and parallelism.
• Knowledgeable in transfer learning, model adaptation, and fine-tuning techniques.
• Ability to conduct independent research and manage long-term projects.

Qualifications

• PhD in Computer Science, Machine Learning, Computer Engineering, Applied Mathematics, Electrical Engineering, or related fields.
• LLM with a focus on NLP, or a Master’s degree with 5 years of industrial NLP research experience.
• Multiple publications on pre-training of large language models, SSL techniques, model pre-training optimization.
• Experience training large language models from scratch (10B+ parameters, 500B+ tokens).
• Papers in deep learning theory, ACL, NAACL, EMNLP, Neurips, ICML, ICLR.
• Experience in training optimization, self-supervised learning, robustness, explainability, RLHF.
• Experience in model sparsification, quantization, training parallelism/partitioning design, gradient checkpointing, model compression.
• Experience in compiler design.
• Experience in finetuning, supervised finetuning, instruction-tuning, dialogue-finetuning, parameter tuning.
• Experience in transfer learning, model adaptation, and model guidance.
• Experience deploying large language models.

Skills

• Strong analytical and problem-solving skills.
• Excellent communication and interpersonal skills.
• Technical proficiency in AI and machine learning frameworks.
• Experience with cloud computing platforms.
• Ability to work independently and manage multiple projects.

Benefits

Capital One offers a comprehensive benefits package that includes:

• Health, financial, and wellness programs.
• Flexible work arrangements.
• Professional development opportunities.
• Discretionary and non-discretionary incentive compensation.

Pay

The minimum and maximum full-time annual salaries for this role vary by location, ranging from $218,700 to $249,600 in Cambridge, MA. Candidates hired for positions in other locations will be paid according to the applicable pay range for that location.

Schedule

This role is full-time.

Contact Information

To apply for this position, visit the Capital One Careers website. For technical support or questions about the recruitment process, email Careers@capitalone.com.

Note: This posting is for the Applied Researcher I (AI Foundations) role. For other positions, please refer to the respective job postings.