Senior Associate, Data Scientist - US Card (Applied GenAI)

About the role

The role involves applying expertise in unstructured data (text, image) to harness the power of open source large language models (LLMs) and visual language models (VLMs), leveraging a broad stack of technologies, building machine learning and NLP models, assessing GenAI or LLM-powered application architectures, defining requirements for AI observability, evaluating dynamic behavior of AI systems, guiding annotators to curate high quality, consistent datasets for model training, evaluation, and ongoing AI monitoring, collaborating on a team of data scientists through all phases of project development, and interacting with a variety of internal stakeholders to ensure the alignment of data science solutions with business outcomes.

Responsibilities

• Apply expertise in unstructured data (text, image) to harness the power of open source large language models (LLMs) and visual language models (VLMs)
• Leverage a broad stack of technologies — LangGraph, LlamaIndex, Weights and Biases Weave, Hugging Face, PyTorch, AWS, and more — to automate workflows using huge volumes of text and vision data
• Build machine learning and NLP models through all phases of development, from design through training, evaluation, and validation; partnering with engineering teams to operationalize them in scalable and resilient production systems that serve 80+ million customers
• Assess GenAI or LLM-Powered application architectures in production, including best practices for Generative AI development and deployments
• Define requirements for AI observability, focusing on the traceability of autonomous decisions and comprehensive system audit trails
• Evaluate the dynamic behavior of AI systems and oversee the development of key continuous monitoring controls and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk appetite
• Guide annotators to curate high quality, consistent datasets for model training, evaluation, and ongoing AI monitoring
• Collaborate on a team of data scientists through all phases of project development, from design through training, evaluation, validation, implementation, and maintenance
• Interact with a variety of internal stakeholders to ensure the alignment of data science solutions with business outcomes

Requirements

• Currently has, or is in the process of obtaining one of the following with an expectation that the required degree will be obtained on or before the scheduled start date: - A Bachelor's Degree in a quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Computer Science, or a related quantitative field) plus 2 years of experience performing data analytics
• A Master's Degree in a quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Computer Science, or a related quantitative field) or an MBA with a quantitative concentration
• Experience working with AWS
• At least 2 years’ experience in Python, Scala, or R
• At least 2 years’ experience with machine learning
• At least 2 years’ experience with SQL
• At least 2 years’ experience AI/ML tools and ecosystems, such as LangGraph, LlamaIndex, Weights and Biases Weave, Pytorch, or Hugging Face

Qualifications

• Customer first. You love the process of analyzing and creating, but also share our passion to do the right thing. You know at the end of the day it’s about making the right decision for our customers.
• Innovative. You continually research and evaluate emerging technologies. You stay current on published state-of-the-art methods, technologies, and applications and seek out opportunities to apply them.
• Creative. You thrive on bringing definition to big, undefined problems. You love asking questions and pushing hard to find answers. You’re not afraid to share a new idea.
• A leader. You challenge conventional thinking and work with stakeholders to identify and improve the status quo. You're passionate about talent development for your own team and beyond.
• Technical. You’re comfortable with open-source languages and are passionate about developing further. You have hands-on experience developing data science solutions using open-source tools and cloud computing platforms.
• Statistically-minded. You’ve built models, validated them, and backtested them. You know how to interpret a confusion matrix or a ROC curve. You have experience with clustering, classification, sentiment analysis, time series, and deep learning.
• A data guru. “Big data” doesn’t faze you. You have the skills to retrieve, combine, and analyze data from a variety of sources and structures. You know understanding the data is often the key to great data science.

Skills

• Expertise in unstructured data (text, image)
• Leveraging a broad stack of technologies
• Building machine learning and NLP models
• Assessing GenAI or LLM-powered application architectures
• Defining requirements for AI observability
• Evaluating dynamic behavior of AI systems
• Guiding annotators to curate high quality, consistent datasets
• Collaborating on a team of data scientists
• Interacting with a variety of internal stakeholders

Benefits

Comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.

Pay

Minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.

McLean, VA: $135,600 - $154,800 for Sr Assoc, Data Science

Schedule

Full-time