Jobs · Engineering · Massachusetts

Senior AI Engineer

7AI · Boston, MA · 1 wk ago
HybridEngineeringFull-time

What You’ll Do

  • Arcitect and build LLM-powered systems — design retrieval workflows, context management, agent prompts, and structured output pipelines.
  • Orchestrate AI workflows using tools like LangChain, LlamaIndex, or similar frameworks, integrating them with product APIs and backend services.
  • Drive prompt engineering and iteration — refine prompts, templates, and context strategies to meet product quality and reliability goals.
  • Manage real-world evaluation metrics — measure usefulness, factual correctness, latency, and UX impact vs. classic accuracy alone.
  • Collaborate across functions — work closely with product, platform, and backend teams to ensure seamless integration.
  • Develop reliable, scalable deployments — focus on performance, cost efficiency, and observability in production environments.

Who You Are

  • Experienced in building real LLM applications — you’ve shipped systems that use large models meaningfully.
  • Strong software engineering skills — Python/TypeScript, API design, backend integration, and cloud deployment.
  • Tool fluency — comfortable with RAG, vector databases (e.g., Pinecone/Weaviate), workflow frameworks (LangChain, Dust), and related tooling.
  • Architectural thinker — you can diagram end-to-end solutions incorporating context windows, caching strategies, tool calls, and multi-step reasoning.
  • Product-oriented — you care not just that the AI works, but that it delivers value safely and reliably to users.

Basic Qualifications

  • 6+ years of software engineering experience, with at least 1+ year working building AI in production.
  • BS Degree in Computer Science or related field. Masters degree is a plus.
  • Demonstrated use of LLMs in production workflows or complex prototypes.
  • Strong coding ability in Python or equivalent; familiarity with backend frameworks and cloud services.
  • Experience with API integrations, database systems, and scalable architectures.
  • Experience with multi-modal models or multi-agent system design.
  • Familiarity with AI safety guardrails, hallucination mitigation, and structured output enforcement.
  • Knowledge of vector DBs, RAG architectures, and prompt lifecycle tooling.

Similar jobs

Senior AI Engineer

HaystackUnited States· Yesterday
RemoteEngineering$70–$80/hrapply on haystack.cv

Senior AI Engineer

Citizen HealthSan Francisco, CA· 5 mo ago
Engineering$150k–$300k/yrapply on jobs.ashbyhq.com

Senior AI Engineer

CamgianLawton, OK· 1 wk ago
Information Technologyapply on camgiancorporation.applytojob.com

Senior AI Engineer

CrunchyrollDallas, TX· 1 wk ago
Information Technologyapply on boards.greenhouse.io