Jobs · Connecticut

Software Engineer AI

Boehringer Ingelheim · Ridgefield, CT · 1 mo ago
$75k–$181k/yrFull-time

Ai Integration & Development

Design and implement LLM-based features and pipelines using frameworks such as LangChain and LangGraph. Build and maintain Retrieval-Augmented Generation (RAG) systems, including vector store management, chunking strategies, embedding pipelines, and retrieval optimization.

Duties & Responsibilities

  • Rapidly explore and evaluate new AI capabilities, tools, and approaches. Translate ambiguous problem statements into working prototypes that demonstrate value and inform product direction.
  • Meet regularly with IT colleagues, product owners, and stakeholders to understand business needs and translate them into well-scoped AI engineering solutions. Communicate tradeoffs clearly across technical and non-technical audiences.
  • Maintain and improve existing AI-integrated systems, troubleshoot pipeline failures, and take corrective action on issues related to retrieval quality, prompt behavior, or model outputs.
  • Contribute to project teams by delivering on assigned tasks and action items, participating in agile ceremonies, and supporting delivery against team goals.

Requirements

  • Core Competencies:
    • Proficiency in Python for AI/ML development and backend service integration.
    • Hands-on experience with LangChain and/or LangGraph for building agentic and multi-step LLM workflows.
    • Strong understanding of RAG pipelines end-to-end: document ingestion, chunking, embedding, vector storage, and query-time retrieval.
    • Familiarity with leading LLM providers and APIs (e.g., OpenAI, Anthropic, Azure OpenAI, AWS Bedrock).
    • Experience with evaluation and testing of AI systems, including retrieval quality metrics, LLM output assessment, and regression testing for prompt changes.
    • Understanding of AI observability and experimentation tooling (e.g., LangSmith, Weights & Biases, or equivalent).
    • Solid foundation in software engineering practices: version control (Git), CI/CD, and containerization (Docker).
    • Effective communication skills with the ability to explain AI system behavior and limitations to non-technical stakeholders.
  • Senior Software Engineer:
    • Associate degree in Computer Science or MIS with a minimum of 4 years experience; or Bachelor degree in Computer Science, or MIS, with a minimum of 2 years of experience; or a Master degree in Computer Science, MIS, with minimum 1 year of experience; or relevant Business or IT experience of minimum of 4 years.
    • Hands-on experience building and shipping software in Python, with working knowledge of REST API development and integration patterns.
    • Practical understanding of RAG architectures, including embedding models, vector databases (e.g., FAISS, Chroma, Pinecone, Weaviate), and retrieval strategies.
    • Familiarity with prompt engineering techniques, including few-shot prompting, chain-of-thought, and system prompt design.
    • Knowledge of software development lifecycle and experience working on agile project teams.
  • Principal Software Engineer:
    • Associate degree in Computer Science, MIS or a related field with a minimum of 7 years experience; or Bachelor degree in Computer Science, or MIS, with a minimum of 5 years of experience; or a Master degree in Computer Science, MIS, with minimum 3 years of experience; or relevant Business or IT experience of minimum of 7 years.
    • Minimum of 4 years of programming preferred.
    • Experience with agentic AI patterns including tool use, multi-agent orchestration, memory management, and reasoning loops using LangGraph or similar frameworks.
    • Exposure to healthcare data standards (e.g., FHIR/HL7) and regulated or privacy-sensitive environments.
    • Experience with structured output generation, function calling, and tool-augmented LLMs.
    • Comfort working with AI-assisted development environments (e.g., GitHub Copilot, Cursor) while maintaining code quality and security standards.
    • Comfort with lightweight discovery methods such as analytics, user interviews, and partnering with design and UX research to validate AI-driven solutions.
    • Interest in responsible AI practices, including bias evaluation, content moderation, and ethical deployment considerations.

Eligibility Requirements

  • Must be legally authorized to work in the United States without restriction.
  • Must be willing to take a drug test and post-offer physical (if required).
  • Must be 18 years of age or older.

Similar jobs

Software AI Engineer

micro1United States· 3 wk ago
RemoteInformation Technologyapply on jobs.micro1.ai

AI Software Engineer

Hallmark: Healthcare's Workforce Operating SystemDallas, TX· 2 wk ago
Engineering$115k–$138k/yrapply on hallmarkhcs.pinpointhq.com

AI Software Engineer

System OneChantilly, VA· 1 mo ago
Information Technologyapply on jobs.systemone.com