AI Systems Engineer

Role Summary

Join Suffolk’s AI Studio in Boston as a n AI Systems Engineer, a hybrid role responsible for architecting and building both:

• The distributed systems backbone that powers enterprise-scale AI
• The agentic and LLM-driven capabilities transforming construction workflows

Responsibilities

Design and implement production-grade RAG architectures
Build and deploy multi-model AI agents leveraging AWS Bedrock and LLM providers (Claude, GPT, Llama, Titan, etc.)
Implement dynamic model routing strategies based on task complexity, cost, and latency
Develop multi-agent orchestration frameworks enabling collaborative workflows (planner, retriever, executor, summarizer)
Design safe tool invocation patterns and guardrails for enterprise AI agents
Optimize inference pipelines for cost, performance, and reliability
Design fallback and degradation strategies for model outages or latency spikes
Collaborate with product managers, site AI engineers, and data scientists to iterate rapidly in Agile sprints
Communicate technical progress clearly to non-technical stakeholders; contribute to internal AI playbooks and templates

Qualifications

• 6+ years of professional software engineering experience (not including vibe coding)
• Demonstrated experience designing distributed or service-oriented systems in production
• Strong backend engineering skills in Python, and at least one of Java, NodeJS, Rust or Kotlin
• Experience building and deploying event-driven architectures (SNS/SQS, Kafka, EventBridge, etc.)
• Experience integrating LLMs into production systems (Bedrock, OpenAI, Anthropic, etc.)
• Hands-on experience with RAG pipelines, vector databases, and building multi-agent AI systems
• Deep understanding of: Distributed system failure modes, API lifecycle management, concurrency and consistency tradeoffs, LLM cost, latency, and reliability constraints, Tuning AI Agents for accuracy and performance

Preferred Experience

• Building internal AI platforms or shared infrastructure
• Exposure to large-scale SaaS or mission-critical systems
• Experience designing multi-agent or orchestration frameworks
• Prior experience in construction, manufacturing, or operational industries

What Makes This Role Unique

This role requires equal fluency in: Designing distributed systems that scale, Engineering intelligent agentic systems that reason. We are looking for engineers who understand that production AI is not just about model quality and prompt engineering — it is also about the systems that deliver, monitor, and evolve those models and agents safely at scale.

Job Site Walking

While performing the duties of this job, the employee is regularly required to sit for long periods of time; talk or hear; perform fine motor, hand and finger skills in the use of a keyboard, telephone, or writing. The employee is frequently required to stand; walk; and reach with arms and/or hands. Specific vision abilities include close vision, distance vision, depth perception and the ability to adjust focus. The employee will spend their time in an office environment with a quiet to moderate noise level.

Compensation Information

Where required by law, pay ranges can be found in Suffolk's job postings. Base Salary for this position is just one component of Suffolk’s total rewards package for employees. Actual salaries may be based on several factors including, but not limited to, a candidate's skill set, experience, education and other qualifications. Suffolk offers a comprehensive benefits package as part of its overall total rewards strategy. Salary ranges are reviewed regularly to reflect market trends.