Jobs · Engineering · Massachusetts

Senior AI Engineer

7AI · Boston, MA · 3 mo ago
HybridEngineeringFull-time

What You’ll Do

  • Arcitect and build LLM-powered systems — design retrieval workflows, context management, agent prompts, and structured output pipelines.
  • Orchestrate AI workflows using tools like LangChain, LlamaIndex, or similar frameworks, integrating them with product APIs and backend services.
  • Drive prompt engineering and iteration — refine prompts, templates, and context strategies to meet product quality and reliability goals.
  • Manage real-world evaluation metrics — measure usefulness, factual correctness, latency, and UX impact vs. classic accuracy alone.
  • Collaborate across functions — work closely with product, platform, and backend teams to ensure seamless integration.
  • Develop reliable, scalable deployments — focus on performance, cost efficiency, and observability in production environments.

Who You Are

  • Experienced in building real LLM applications — you’ve shipped systems that use large models meaningfully.
  • Strong software engineering skills — Python/TypeScript, API design, backend integration, and cloud deployment.
  • Tool fluency — comfortable with RAG, vector databases (e.g., Pinecone/Weaviate), workflow frameworks (LangChain, Dust), and related tooling.
  • Architectural thinker — you can diagram end-to-end solutions incorporating context windows, caching strategies, tool calls, and multi-step reasoning.
  • Product-oriented — you care not just that the AI works, but that it delivers value safely and reliably to users.

Basic Qualifications

  • 6+ years of software engineering experience, with at least 1+ year working building AI in production.
  • BS Degree in Computer Science or related field. Masters degree is a plus.
  • Demonstrated use of LLMs in production workflows or complex prototypes.
  • Strong coding ability in Python or equivalent; familiarity with backend frameworks and cloud services.
  • Experience with API integrations, database systems, and scalable architectures.
  • Experience with multi-modal models or multi-agent system design.
  • Familiarity with AI safety guardrails, hallucination mitigation, and structured output enforcement.
  • Knowledge of vector DBs, RAG architectures, and prompt lifecycle tooling.

Similar jobs

Senior AI Engineer

Acadian Asset ManagementBoston, MA· 1 mo ago
$175k–$225k/yrapply on app.greenhouse.io

Senior AI Engineer

AllstateUnited States· 3 mo ago
RemoteEngineeringapply on allstateinsurance.contacthr.com

Senior AI Engineer

Tiger AnalyticsJersey City, NJ· 4 mo ago
RemoteEngineeringapply on apply.workable.com

Senior AI Engineer

MedicaHopkins, MN· 3 mo ago
Engineering$113k–$194k/yrapply on recruiting2.ultipro.com

Senior AI Engineer

Montefiore Health SystemBronx, NY· 5 mo ago
Engineering$184k–$230k/yrapply on montefiore.wd12.myworkdayjobs.com

Senior AI Engineer

Re:Build ManufacturingSeattle, WA· 4 mo ago
Engineering$144k–$216k/yrapply on grnh.se