Junior Software Engineer

Belay Technologies has been voted Baltimore Business Journal's Best Places to Work (2019, runner-up in 2020, finalist in 2021) and specializes in systems automation and full-stack development for the DoD and commercial products.

About the role

Join the AI infrastructure team to build and maintain the foundation for customer AI capabilities, ensuring access to high-quality large language models (LLMs) across the inference software stack. Adapt quickly to evolving mission needs and emerging technologies, turning loosely defined problems into working solutions.

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to users.
• Develop in-house services and techniques to guarantee high-quality inference service for customers.
• Work with model vendor teams to create reliable pipelines for closed-source model usage.
• Collaborate on surge efforts to support short-term, high-priority inference needs.
• Engage with other teams to establish solid infrastructure and integrate LLM-powered tools for user needs.

Requirements

• Active TS/SCI Clearance with polygraph.
• 3+ years of experience with a B.S. in a technical discipline (or 4 additional years of experience in lieu of a degree).

Skills

• Experience with Python and/or other modern programming languages.
• Familiarity with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Familiarity with AWS or other cloud service providers.
• Ability to learn new technologies quickly.
• Strong communication skills and willingness to ask questions.

Nice to Haves

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience with other LLM hosting frameworks and practices.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Experience with Elastic, Grafana/Prometheus, or other observability frameworks.
• Experience with Docker and containerization.
• Experience in traffic shaping and quality-of-service engineering.
• Knowledge of and interest in hosting AI capabilities.

Benefits

• 8 weeks paid leave: 4 weeks personal leave, 3 Yay! days, birthday off, 11 paid holidays, plus optional leave up to 6 days through Belay’s volunteer program.
• 10% matching in 401(k) contributions, vested on day one.
• $5,000 annual training/tuition reimbursement.
• Student Loan Repayment Program.
• 100% company-funded HSA.
• Rich medical coverage (100% coinsurance).
• Dental coverage including orthodontia.
• Up to $420,000 in life insurance, premiums 100% company-funded.
• Amazon Prime, gym reimbursement, monthly lunches, games, and prizes.
• Pet adoption program, generous referral bonus program, and fun events.

Pay

Salary range: $70,000 to $190,000. Final salary influenced by geographic location, contract labor categories, relevant experience, education, skills, and certifications.