Data Scientist II - AI Assurance Researcher
About the Role
The AI and Data Analytics Division, part of the National Security Directorate (NSD), combines profound domain expertise and creative integration of advanced hardware and software to deliver computational solutions that address complex data and analytic challenges. Working in multidisciplinary teams, we connect foundational research to engineering to operations, providing the tools to innovate quickly and field results faster. Our strengths are integrated across the data analytics lifecycle, from data acquisition and management to analysis and decision support.
PNNL is seeking a Data Scientist II - AI Assurance Researcher who has experience in understanding, exploring, and manipulating the internal mechanics and behaviors of AI models and can provide valuable insights into the decision boundaries and mathematical fingerprints of data properties. The selected candidate should have extensive experience training models, accessing and working with data embeddings, the ability to derive theoretical queries from empirical results, and demonstrate the capacity to translate research papers and findings into mission relevant insights and tools.
Responsibilities
- Designs and executes rigorous ML experiments following community best practices, including large-scale training and evaluation on HPC infrastructure.
- Evaluates AI systems across multiple dimensions, including standard performance metrics, generalization, robustness, and out-of-distribution behavior.
- Analyzes the internal structures and representations of deep learning models, with emphasis on large language models and large vision models.
- Assesses empirical results to identify trends, inform research direction, and recommend next steps.
- Writes high-quality, well-documented research code that supports reproducibility and collaboration.
- Contributes to publications and technical reports that communicate findings to both internal and external audiences.
- Collaborates with senior researchers, engineers, and cross-functional teams to integrate research into broader systems and workflows.
- Conducts work in secure environments with adherence to operational security requirements.
This position is based in either Richland, WA or Seattle, WA and requires an onsite presence.
Minimum Qualifications
- BS/BA and 2 years of relevant experience -OR-
- MS/MA -OR-
- PhD
Preferred Qualifications
- Degree in computer science, engineering, mathematics, or a related field.
- Familiarity with the current ML research landscape, particularly in explainable AI, adversarial machine learning, AI safety, and the science of deep learning.
- Hands-on experience analyzing the internal structures of deep learning models, particularly large language models and large vision models.
- Proficiency in PyTorch and associated deep learning libraries.
- Experience designing and executing experiments on HPC systems.
- Experience in translating research prototypes into deployable tools and capabilities.
- Demonstrated strong communication and collaboration skills, with the ability to work effectively in a multi-disciplinary team environment.
Security Clearance Requirements
This position requires the ability to obtain and maintain a federal security clearance. U.S. Citizenship is required. Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance with 10 CFR 710, Appendix B. This position is a Testing Designated Position (TDP), meaning the candidate selected will be subject to pre-employment and random drug testing for illegal drugs, including marijuana. Applicants must be able to demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).
Benefits
Employees and their families are offered medical insurance, dental insurance, vision insurance, robust telehealth care options, several mental health benefits, free wellness coaching, health savings account, flexible spending accounts, basic life insurance, disability insurance, employee assistance program, business travel insurance, tuition assistance, relocation, backup childcare, legal benefits, supplemental parental bonding leave, surrogacy and adoption assistance, and fertility support. Employees are automatically enrolled in our company-funded pension plan and may enroll in our 401(k) savings plan with company match. Employees may accrue up to 120 vacation hours per year and may receive ten paid holidays per year.
Pay
Minimum Salary USD $114,000.00/Yr. Maximum Salary USD $182,100.00/Yr. Starting pay is calculated from the minimum of the pay range and actual placement in the range is determined based on an individual's relevant job-related skills, qualifications, and experience, without consideration of current or past salaries.
This response is AI-generated, for reference only.