Jobs · Engineering · Illinois

Senior Engineer, Applied AI & Engineering Platforms

BioSpace · North Chicago, IL · 3 wk ago
EngineeringFull-time

Agentic System Design & Engineering

  • Architect and own production-grade multi-agent systems using orchestration frameworks (LangChain, LangGraph, CrewAI, OpenAI Agents SDK, AutoGen/AG2, Semantic Kernel), making deliberate decisions on state management, routing, memory architecture, and failure handling.
  • Design agent cognitive architectures planning loops (ReAct, Reflexion, CoT), tool-use patterns, memory systems (short-term, episodic, semantic), and self-evaluation loops.
  • Build multi-agent coordination patterns (supervisor-worker, peer collaboration, A2A protocols) aligned with emerging open standards including MCP server integration to connect agents to enterprise systems, clinical data platforms, and regulatory repositories.

AI Foundations Layer

  • Design and maintain shared AI infrastructure: LLM gateway/routing, embedding services, vector stores, RAG pipelines, prompt management, and model evaluation harnesses across all agentic products.
  • Establish model selection and governance spanning hosted providers (Claude, GPT, Gemini) and self-hosted models, including fine-tuning pipelines (LoRA/QLoRA) for pharmaceutical-specific tasks.
  • Build context engineering standards managing context windows, retrieval strategies, chunking, re-ranking, hybrid search, and query routing for enterprise-scale clinical and scientific knowledge with guardrails, safety layers, content filters, and HITL escalation appropriate for GxP environments.

Agentic Engineering SDLC

  • Define the end-to-end SDLC for agentic systems from design through evaluation, deployment, and continuous monitoring treating agent behavior as a first-class software artifact subject to change control.
  • Build agent evaluation frameworks (golden test sets, LLM-as-judge scoring, regression detection, task-completion benchmarks, latency/cost dashboards) and CI/CD pipelines with automated evaluation gates, drift detection, and rollback capabilities.
  • Establish traceability, audit logging, and versioning standards supporting GxP validation, 21 CFR Part 11, and AbbVie’s AI governance policy.

Observability, Reliability & AIOps

  • Implement full-stack observability (LangSmith, Langfuse, OpenTelemetry): trace-level logging, token/cost tracking, latency profiling, and anomaly detection on agent behavior.
  • Own production reliability retry logic, fallback strategies, circuit breakers, graceful degradation, and HITL escalation for regulated workflows. Monitor for behavior drift and decision inconsistency; implement continuous feedback loops without introducing regressions.
  • Integrate agentic services with enterprise platforms (Salesforce, MuleSoft, Veeva, SAP, Databricks, ServiceNow) using MCP and standardized API patterns.

Governance, Compliance & Responsible AI

  • Design agent authorization models operationalizing AbbVie’s AI risk tiers (HIGH/LOW), defining what agents can access, act on, and decide autonomously versus what requires human approval.
  • Implement governance controls aligned with FDA AI/ML guidance, ICH E6/E8, EU AI Act, and AbbVie internal policy ensuring compliance with data residency, privacy (HIPAA, GDPR), least-privilege access, prompt injection defense, and secure MCP/A2A integrations.
  • Build validation artifacts satisfying audit requirements for agents in clinical, regulatory, and GxP-controlled workflows.

Cross-Functional Technical Leadership

  • Partner with product managers, data scientists, enterprise architects, platform security, and domain teams to translate pharmaceutical problems into agent system designs; define reusable patterns and shared platform components that accelerate development across teams.
  • Mentor engineers on the agentic AI platform, conduct architecture reviews, establish engineering standards, and foster a culture of production-quality AI development while driving adoption of emerging standards (MCP, A2A, evaluation benchmarks) relevant to AbbVie’s environment.

Qualifications

  • Minimum years of experience: 6+ with Bachelors, or 5+ with Masters, or 0+ with PhD in software engineering with demonstrated depth in AI/ML systems, NLP/LLM applications, or production AI platforms including experience building Generative AI or LLM-powered applications in production environments.
  • Strong Python proficiency including async programming (asyncio), RESTful API design (FastAPI), system design patterns for scalable distributed AI systems, and production-quality coding practices.
  • Hands-on experience building and operating RAG pipelines: embedding models, vector databases (e.g., pgvector, Pinecone, Azure AI Search), chunking strategies, hybrid retrieval, and retrieval evaluation. Familiarity with LlamaIndex or similar RAG frameworks is a plus.
  • Experience with one or more cloud AI platforms (AWS Bedrock, Azure AI Foundry, or Google Vertex AI) including serverless inference and managed agent services.
  • Solid understanding of prompt engineering at the system level: system prompt design, structured output formats, tool-call schemas, context engineering, and prompt versioning.
  • Clear communication skills ability to articulate agent architecture decisions, risk tradeoffs, and compliance implications to both technical engineers and non-technical business stakeholders.

Similar jobs