Applied Researcher I

About the role

The Applied Researcher I position at Capital One focuses on bringing the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses. This role involves working closely with a cross-functional team to deliver AI-powered products that enhance customer interactions.

Responsibilities

• Partner with a cross-functional team of data scientists, software engineers, machine learning engineers, and product managers to develop AI-powered products.
• Leverage a broad stack of technologies including Pytorch, AWS Ultraclusters, Huggingface, Lightning, VectorDBs, and more to uncover insights from large datasets.
• Build AI foundation models throughout the entire development lifecycle, from design to training, evaluation, validation, and deployment.
• Innovate by engaging in high-impact applied research to advance the state of the art in AI and integrate these advancements into customer experiences.
• Communicate complex AI concepts to stakeholders, translating technical details into actionable business goals.

Requirements

• Currently pursuing or recently obtained a PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields, or a Master's degree in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields with 2 years of relevant experience.
• Innovative and creative, with a strong interest in researching and applying emerging technologies.
• Able to lead and motivate a team while maintaining a deep understanding of AI methodologies and practical experience in developing AI foundation models.
• Proficient in open-source languages and cloud computing platforms, with hands-on experience in developing large-scale deep learning models.
• Experience with training optimization, self-supervised learning, robustness, explainability, RLHF, and familiarity with compiler design.
• Experience in model sparsification, quantization, training parallelism/partitioning design, gradient checkpointing, model compression, and deep learning algorithmic design.
• Expertise in model finetuning, transfer learning, model adaptation, and model guidance, with experience deploying large language models.

Qualifications

• Strong academic background in computer science, electrical engineering, or related fields.
• Multiple publications on topics related to pre-training of large language models, SSL techniques, model pre-training optimization, and deep learning theory.
• Experience in training large language models from scratch, including those with 10B+ parameters and 500B+ tokens.
• Knowledge of optimization techniques, including training and inference, and experience with compiler design.
• Experience in model finetuning, including supervised finetuning, instruction-tuning, dialogue-finetuning, and parameter tuning.
• Deep understanding of deep learning algorithms and optimizer design.

Skills

• Strong programming skills in Python and other relevant languages.
• Experience with Spark and other big data processing frameworks.
• Knowledge of cloud computing platforms like AWS.
• Ability to communicate complex technical concepts to non-technical stakeholders.

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits designed to support your total well-being. These benefits include:

• Comprehensive health insurance plans.
• Financial wellness programs.
• Flexible spending accounts.
• Retirement savings plans.
• Employee assistance programs.

Pay

The minimum and maximum full-time annual salaries for this role vary by location. For example, in New York, NY, the salary range is $218,700 - $249,600 for Applied Researcher I. The actual salary offered to any candidate at the time of hire will be reflected in the offer letter.

Schedule

This role is full-time and requires regular attendance and availability to meet project deadlines and collaborate with the team.