Senior Software Engineer

Responsibilities

• Architect the Future of Runtimes
• Design and implement high-performance hosting environments for both specialized models and autonomous agents
• Scale Hybrid-Cloud Infrastructure
• Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments
• Drive Operational Excellence
• Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents and models in production
• Operational Stewardship
• Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services
• Collaborate and Advocate
• Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value

Qualifications

• Bachelor's Degree in Computer Science/Engineering, or related field with 5 years of experience
• OR an Associate's degree in Computer/Science/Engineering, or related field with 7 years of experience
• In-depth knowledge of software engineering with experience coding applications or services in a high-level language (C, C++, Golang, Java, C# etc.) and a basic knowledge of related fields
• Demonstrated problem solving and time management skills
• Strong technical aptitude for designing and implementing software solutions
• Experience with modern application development frameworks
• Knowledge of professional software engineering practices and best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Deep hands-on technical expertise, excellent verbal and written communication skills
• Experience with Agile software development techniques
• Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (4+ years of in-depth Kubernetes is a must)
• AI/ML Fluency: Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures
• Operational Rigor: A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments
• Problem-Solving Mindset: Ability to turn abstract AI research into production-grade, hardened platform features

Preferred Qualifications

• Master's degree in Computer Science/Engineering or related field
• Ability to use a wide variety of open-source technologies and cloud-based services
• Experience writing software for the cloud (GCP, AWS, Azure)
• Experience in databases, analytics, big data systems or business intelligence products
• Experience building high-performance, highly available and scalable distributed systems
• Experience developing software for healthcare related industries

Benefits

The salary range for this role is $115,000 to $165,000 or the hourly equivalent. Pay is based on several factors including but not limited to education, work experience, certifications, etc. In addition to your salary, Turnberry Solutions offers benefits such as a comprehensive healthcare package (medical, dental, vision), disability and group term life insurance, health and flexible spending accounts, a utilization bonus, 401(k) with match, flexible time off for salaried employees, parental leave for salaried employees, and flexible work arrangements (all benefits are subject to eligibility requirements).