Senior AI Engineer

Job Overview

NBME is seeking a highly skilled Senior AI Engineer to build, maintain, and scale AI-driven systems. This role is critical for translating research innovations into production-ready pipelines and tools supporting multiple programs, products, and services.

Responsibilities

• Design, implement, and maintain production-grade AI and NLP pipelines, including model training, deployment, monitoring, and updates.
• Collaborate with research teams on pre-production research and operationalize prototypes, ensuring reproducibility, scalability, and robustness.
• Build and maintain infrastructure for embeddings, large language models, and other AI assets.
• Optimize AI systems for performance, reliability, and cost-efficiency.
• Implement and maintain monitoring, logging, and alerting for AI systems in production.
• Ensure compliance with data security, privacy, and organizational standards.
• Support multiple product teams by providing AI engineering expertise, tools, and best practices.
• Contribute to technical documentation, knowledge sharing, and internal training initiatives.

Qualifications

• Required:
• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field.
• Minimum 5 years of experience in AI/ML engineering, including model deployment, MLOps, system monitoring, and production pipelines.
• Proficiency with Python and AI/ML libraries (e.g., PyTorch, TensorFlow, Hugging Face Transformers).
• 8 years of experience with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes).
• Familiarity with vector databases, embeddings, and large-scale NLP applications.
• Strong problem-solving skills and ability to work collaboratively in a cross-functional team.
• Excellent communication skills for technical and non-technical stakeholders.

Benefits

• Healthcare, Dental, Prescription, and Vision plans
• 401(k) with match
• Tuition Reimbursement Plan
• Commute Benefit: Public Transit or Parking options
• Remote Friendly Workplace

About NBME

NBME is a not-for-profit organization specializing in creating assessments and learning tools for physicians and health professionals. Founded in 1915, NBME develops and manages the United States Medical Licensing Examination® with the Federation of State Medical Boards. The organization is dedicated to advancing innovative assessment approaches through research, collaboration, and contributions to medical education and assessment communities.

Equal Opportunity Employer

NBME is an Equal Opportunity Employer, considering all qualified applicants without regard to race, color, sex, gender identity, sexual orientation, religious practices, national origin, pregnancy, veteran status, or disability.