Senior Software Engineer – Inference

About the role

Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. In this role, you’ll help build and maintain the foundation for AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Responsibilities

• Lead the evaluation, configuration, and deployment of inference models for our users.
• Mentor engineers and grow development best practices and standards for the team.
• Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.

Requirements

• 12 years of experience with a Bachelor’s degree in a technical discipline, or 16 years without a degree.
• Active TS/SCI with Polygraph clearance (required).

Skills

Required

• Experience with Python and/or other modern programming languages.
• Experience with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Experience with AWS or other cloud service providers.
• Strong communication skills and ability to mentor other engineers.
• Excellent leadership and stakeholder management skills.

Nice to have

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Knowledge of and interest in hosting AI capabilities.

Pay

Salary range: $204,000 - $247,000

Location

Columbia, MD