Senior Applied Scientist
Qualtrics · Reston, VA · 6 days ago
AnalystFull-time
About the role
We are seeking a Senior Applied Scientist to lead our Machine Learning and Artificial Intelligence R&D efforts. The ideal candidate will leverage deep knowledge of AI principles and techniques to personalize the Qualtrics experience and drive innovation.
Responsibilities
- Leverage deep knowledge of machine learning, natural language processing, and reinforcement learning.
- Develop and optimize scalable and efficient AI applications.
- Tackle challenging problems creatively, using generative models to address real-world use cases.
- Show strong programming skills in Python and proficiency in deep learning frameworks.
- Communicate technical concepts effectively to non-technical stakeholders and gather requirements for AI application development.
- Design and execute evaluation strategies for agentic systems, including rubric-based success criteria, multi-turn conversation simulation, and LLM-as-a-judge frameworks.
- Work as part of a multidisciplinary team to research, implement, evaluate, optimize, productize and maintain cutting-edge machine learning models.
- Stay on top of the latest developments in machine learning and related research, and present research findings with the broader community.
- Lead and engage in design reviews, modeling discussions, requirement definitions, and other technical activities in diverse capacity.
- Mentor and grow junior scientists, drive best practices for experimentation, reproducibility, monitoring and lifecycle management, and ensure models are reliable, scalable and impactful in production.
- Champion Evaluation-Driven Development (EDD) by embedding automated testing, risk-based assessments, and production monitoring into the full agentic lifecycle.
Requirements
- Bachelor's and Ph.D. in Computer Science or related fields.
- 2+ years of post-graduate industrial research experience in machine learning, NLP, information retrieval, deep learning or a related field.
- Deep learning implementation expertise (MxNet, TensorFlow, PyTorch etc).
- Excellent communication, writing and presentation skills.
- Excellent command of at least one modern programming language (preferably Python).
- Excellent problem-solving ability.
- Depth in one or more of the following: Natural Language processing, information retrieval, speech processing, deep learning, reinforcement learning, etc.
- Knowledge of or experience in building production-quality and large-scale deployment of applications related to machine learning.
- Comfortable working in a fast-paced, highly collaborative, dynamic work environment.
- Experience in machine learning systems (e.g. SageMaker, MLFlow), and deep learning frameworks (e.g. TensorFlow, PyTorch, MXNet etc).
- Preference for a publication record in top-tier ML and NLP conferences (e.g. NeurIPS, ICML, SIGIR, ICLR, ACL, EMNLP, etc.).
- Proven track record in evaluating complex, multi-turn agentic systems.
- Deep experience with observability tools, evaluating tool-use reliability, and implementing systematic benchmarking in CI/CD pipelines.
Qualifications
- On your resume, highlight your deep knowledge of AI principles, including machine learning, natural language processing, and reinforcement learning.
- Showcase your understanding of both supervised and unsupervised learning techniques and their applications in building intelligent systems.
- Provide examples of how you have developed and optimized algorithms for building scalable and efficient AI applications.
- Describe your experience tackling challenging problems in creative ways, leveraging generative models to address real-world use cases and drive innovation.
- Include evidence of your ability to communicate technical concepts to non-technical stakeholders and gather requirements for AI application development.
- Provide details on your experience designing and executing evaluation strategies for agentic systems, including rubric-based success criteria, multi-turn conversation simulation, and LLM-as-a-judge frameworks.
- Detail your experience working as part of a multidisciplinary team to research, implement, evaluate, optimize, productize and maintain cutting-edge machine learning models.
- Showcase your ability to stay on top of the latest developments in machine learning and related research, and present research findings with the broader community.
- Provide examples of your leadership and engagement in design reviews, modeling discussions, requirement definitions, and other technical activities in diverse capacity.
- Highlight your experience mentoring and growing junior scientists, driving best practices for experimentation, reproducibility, monitoring and lifecycle management, and ensuring models are reliable, scalable and impactful in production.
- Provide examples of your championing of Evaluation-Driven Development (EDD) by embedding automated testing, risk-based assessments, and production monitoring into the full agentic lifecycle.
Skills
- Strong programming skills in Python.
- Proficiency in deep learning frameworks such as TensorFlow, PyTorch, or similar.
Benefits
Qualtrics offers a variety of benefits including wellness reimbursement, an experience bonus, and participation in various employee groups and communities. We also offer a flexible hybrid work model with in-office days and remote work options.
Pay
Details on pay will be provided during the interview process.
Schedule
The role is full-time and requires a regular schedule.