Distinguished AI Engineer (Remote)

Job Responsibilities

• Partner with cross-functional teams (engineers, scientists, PMs, TPMs) to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, similarity search, guardrails, model evaluation, governance, and observability).
• Leverage Open Source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.

Basic Qualifications

• Education & Experience: Bachelor's degree (CS, AI, EE, etc.) + 8+ years experience OR Master's degree in related fields + 6+ years experience.
• Programming: At least 8 years of experience programming with Python, Go, Scala, or Java.

Preferred Qualifications

• 8 years of experience deploying scalable, responsible AI solutions on cloud platforms (AWS, GCP, Azure).
• Experience architecting and supporting complex AI systems.
• Ability to lead and mentor engineering teams and influence stakeholders up to the VP level.
• Development experience in AI/ML algorithms (LLM Inference, Similarity Search, VectorDBs, Guardrails) using Python, C++, C#, Java, or Golang.
• Experience optimizing training and inference software for hardware utilization, latency, throughput, and cost.
• Passion for latest AI research and applying novel techniques in production.
• Excellent communication skills to articulate complex AI concepts.

Salary Information

McLean, VA: $269,100 - $307,200 (Annual)

Other locations (as reference): Cambridge, MA ($269,100-$307,200); NY ($293,600-$335,100); Richmond, VA ($244,700-$279,200); San Francisco/Jose, CA ($293,600-$335,100).

Includes eligibility for performance-based incentive compensation (bonus/LTI).

Benefits & Legal

• Comprehensive health, financial, and well-being benefits.
• Eligible for employment authorization sponsorship.
• Equal Opportunity Employer (EOE).
• Drug-free workplace.

Job Details

Location: McLean, VA

Job Type: hybrid or office

Posted: May 8, 2026

Categories: Software Engineering

Note: This position is open and accepting applications. Click the button below to apply directly on the company's website.

Please mention that you found this job on chatgpt-jobs. This helps us get more companies to post here!