Jobs · Massachusetts

Principal Software Engineer - AI

Top Gen AI Jobs · Boston, Massachusetts, United States · 5 days ago
$145k–$217k/yrFull-time

About the role

New Balance is hiring a Principal Software Engineer for its Enterprise AI Solutions team. The role focuses on designing and delivering enterprise AI assistants and automations to improve internal workflows, decision-making, and operational efficiency.

Location

Brighton, Massachusetts, United States of America; occasional travel to Lawrence, MA.

Responsibilities

  • Research and deliver AI-based solutions across the company
  • Improve internal workflows, decision-making, and operational efficiency
  • Design and build enterprise-grade AI assistants and automations using RAG and agentic AI
  • Architect autonomous and semi-autonomous agents for multi-step business processes
  • Partner with leadership in Finance, Supply Chain, and Product to identify automation opportunities
  • Translate business needs into scalable AI solutions
  • Lead selection and implementation of models, tools, frameworks, and SDKs across open source and Microsoft AI ecosystem
  • Ensure solutions meet enterprise standards for security, privacy, and cost-efficiency
  • Design human-in-the-loop systems and technical guardrails
  • Oversee the full lifecycle from PoC to production-grade integration with internal APIs and databases
  • Act as a subject matter expert on LLM orchestration
  • Guide other engineers on best practices for RAG and agentic reasoning
  • Work closely with cross-functional partners, data and platform teams, and other engineers
  • Design, implement, and deploy AI-enabled systems that are reliable and maintainable
  • Use visual communication to explain AI logic to business stakeholders
  • Base the position in the Brighton, MA corporate office
  • Travel occasionally to Lawrence, MA
  • Work in a hybrid model with three in-office days per week
  • Use Work from Anywhere for four weeks per calendar year
  • Support enterprise systems across operations, supply chain, finance, product, and corporate services

Requirements

  • 10+ years of software development experience
  • 4+ years focused on AI/Machine Learning and Large Language Models
  • Hands-on experience with LangChain, LangGraph, or Semantic Kernel
  • Experience with Azure OpenAI Service, Azure AI Search, Microsoft Copilot Studio, and related areas
  • Expert-level Python skills
  • Comfortable with React or similar front-end development
  • Strong background in designing RESTful APIs
  • Experience integrating AI agents with ERPs, CRMs, and SQL/NoSQL databases
  • Ability to choose the right AI approach for the business problem
  • Ability to explain complex AI logic and agentic workflows to non-technical stakeholders

Qualifications

  • Degree in Computer Science, Data Science, or a closely related field

Skills

  • LLM
  • RAG
  • Agentic AI
  • LangChain
  • Azure OpenAI Service
  • LangGraph
  • Semantic Kernel
  • Azure AI Search
  • Microsoft Copilot Studio
  • Microsoft Foundry
  • Python
  • React
  • REST API
  • SQL
  • NoSQL
  • AI
  • Machine Learning
  • LLM orchestration
  • ERPs
  • CRMs
  • Prompt engineering
  • Fine-tuning
  • Human-in-the-loop systems
  • Technical guardrails
  • Enterprise backends
  • LLMOps
  • Chainlit
  • Streamlit
  • Prompt injection mitigation
  • Secure data handling

Nice to Have

  • Experience with Azure AI Search as a vector store
  • Familiarity with persistent memory and long-term state management for multi-session AI agents
  • Experience setting up LLMOps pipelines for model performance, drift, and hallucination monitoring
  • Familiarity with Chainlit or Streamlit for rapid internal prototyping
  • Understanding of prompt injection mitigation in GenAI applications

Pay

$144.6K–216.9K/yr

Schedule

  • Full-time
  • Hybrid (three in-office days per week)

Similar jobs