Distinguished Applied Researcher
About the role
The AI Foundations team at Capital One is central to bringing our vision for AI at Capital One to life. Our work spans the entire research lifecycle, from academic partnerships to production systems. We collaborate with product, technology, and business leaders to apply the latest advancements in AI to our business needs.
Responsibilities
- Partner with a cross-functional team of data scientists, software engineers, machine learning engineers, and product managers to deliver AI-powered products that enhance customer interactions.
- Leverage a diverse stack of technologies, including Pytorch, AWS Ultraclusters, Huggingface, Lightning, VectorDBs, and more, to uncover insights from vast datasets.
- Build AI foundation models throughout the development lifecycle, from design to training, evaluation, validation, and deployment.
- Engage in high-impact applied research to advance AI capabilities and integrate them into customer experiences.
- Use your interpersonal skills to translate complex AI concepts into actionable business goals.
Requirements
- PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields with 4 years of experience in Applied Research.
- M.S. in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields with 6 years of experience in Applied Research.
- Experience with large-scale model training, including training optimization, self-supervised learning, robustness, explainability, RLHF, and expertise in one or more of the following areas: training optimization, self-supervised learning, robustness, explainability, RLHF.
- Track record of delivering models at scale in terms of training data and inference volumes.
- Experience contributing to the development of large language models from scratch or through continued pre-training, post-training pipelines for alignment and reasoning, LLM optimizations, complex reasoning with multi-agent LLMs.
- Multiple publications at major conferences like ACL, NAACL, EMNLP, Neurips, ICML, or ICLR on topics related to the pre-training of large language models.
- Experience working on large language models (open source or commercial) that are currently available for use.
- Demonstrated ability to guide the technical direction of a large-scale model training team.
- Experience with common training optimization frameworks (e.g., deep speed, nemo).
- Experience with large language models (open source or commercial) that are currently available for use.
Qualifications
- PhD in Computer Science, Machine Learning, Computer Engineering, Applied Mathematics, Electrical Engineering or related fields.
- LLM.
- Focus on NLP or Masters with 10 years of industrial NLP research experience.
- Core contributor to a team that has trained a large language model from scratch (10B + parameters, 500B+ tokens) or through continued pre-training, post training pipeline for alignment and reasoning, LLM optimizations, complex reasoning with multi-agentic LLMs.
Skills
- Innovative and creative problem-solving skills.
- Strong communication and interpersonal skills.
- Technical proficiency in AI methodologies and open-source tools.
- Experience with cloud computing platforms.
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits designed to support your total well-being. Learn more at the Capital One Careers website.
Pay
Salaries for this role vary by location and are listed below:
- Cambridge, MA: $306,300 - $349,500 for Distinguished Applied Researcher
- McLean, VA: $306,300 - $349,500 for Distinguished Applied Researcher
- New York, NY: $334,100 - $381,300 for Distinguished Applied Researcher
- San Francisco, CA: $334,100 - $381,300 for Distinguished Applied Researcher
- San Jose, CA: $334,100 - $381,300 for Distinguished Applied Researcher
Schedule
This role is full-time.
Equal Opportunity Employer
Capital One is an equal opportunity employer (EOE) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.