Mid-Level Software Engineer – AI Infrastructure

Responsibilities

• Design, implement, and optimize infrastructure for AI model inference at scale.
• Support the development and maintenance of production AI services and applications.

Requirements

• Proven experience building and maintaining production systems at scale.
• Experience with high-volume web application architecture and performance optimization.
• Strong background in systems integration across diverse technologies and platforms.
• Hands-on experience with cloud engineering in AWS.
• Proficiency with Kubernetes administration and deployment patterns.
• Strong Python programming skills.
• Experience implementing observability solutions (APM, OpenTelemetry, Grafana, Prometheus).
• Strong change management and organizational influence skills.
• Excellent communication and collaboration skills.

Nice to Have

• Experience with AI inference serving technologies (vLLM, LiteLLM, etc.).
• Previous experience with agentic frameworks (LangChain).
• Knowledge of vector databases and embedding systems.
• Experience with high-performance computing or distributed systems.

Qualifications

• 8 years of experience with a Bachelor’s degree in a technical discipline, or 12 years without degree.

Skills

• Experience with cloud engineering in AWS.
• Proficiency with Kubernetes administration and deployment patterns.
• Strong Python programming skills.
• Experience implementing observability solutions (APM, OpenTelemetry, Grafana, Prometheus).
• Strong change management and organizational influence skills.
• Excellent communication and collaboration skills.

Benefits

• Not specified

Pay

• $148,000 - $177,000

Schedule

• Not specified

Location

• Columbia, MD

Clearance

• TS/SCI with Polygraph required