Staff Software Engineer, AI Governance

About the role

Serves as the Staff technical engineer and visionary responsible for building the infrastructure, tooling, and frameworks that ensure our Artificial Intelligence and Machine Learning systems are safe, compliant, transparent, and trustworthy. This is a high-impact, cross-functional role. You will bridge the gap between cutting-edge AI engineering, legal compliance, and ethical safety standards. You will design and implement scalable systems to monitor, audit, and govern large language models (LLMs), predictive models, and autonomous agents across the entire enterprise product lifecycle.

Responsibilities

• Architecture & Core Engineering: Design, build, and maintain enterprise-grade AI governance platforms, including automated pipelines for model lineage, bias detection, drift monitoring, and compliance auditing.
• Agentic Guardrails & Orchestration: Design and enforce deterministic guardrails for autonomous AI agents, ensuring agent reasoning loops cannot execute actions that bypass HIPAA controls or data boundaries.
• Standards & Frameworks: Establish engineering standards, best practices, and internal processes for reproducible ML and responsible AI deployment.
• Technical Leadership: Mentor mid-level and senior engineers, drive technical roadmaps, and make critical architecture decisions regarding AI safety.
• Integration Platform Direction: Contribute to the technical direction of the integration platform by proposing and implementing improvements to architecture, tools, and technologies.
• Production Reliability: Identify and resolve performance bottlenecks, troubleshoot integration issues, and proactively improve the reliability of integrations in production environments.
• Healthcare Compliance & Security: Ensure all integration work adheres to healthcare compliance and security standards, including HIPAA, HL7, and FHIR, while collaborating with security teams to protect sensitive data.
• Cross-Functional Collaboration: Partner closely with Legal, Compliance, Security, Data Privacy, and AI Research teams to translate complex regulatory requirements into concrete, automated technical solutions. Vendor assessment and risk management along with secure LLM integrations.

Requirements

• 8+ years of professional software engineering experience, with at least 3+ years specifically focused on production ML systems, MLOps, or AI safety infrastructure.
• Proven track record of designing and implementing end-to-end solutions and making successful architectural decisions in complex, enterprise-scale environments.
• High proficiency in Python and at least one systems language (e.g., Go, Java, C++).
• Strong understanding of LLM architectures, transformer models, retrieval-augmented generation (RAG), and traditional ML algorithms.
• Experience building/assessing enterprise-grade AI proxy layers and tools to automatically detect, redact, or anonymize PHI before data reaches external LLM APIs.
• Familiarity with LLM-specific security vulnerabilities (e.g., OWASP Top 10 for LLMs).
• Experience adapting commercial AI models (like OpenAI or Anthropic) into healthcare workflows safely.

Qualifications

B.S. or M.S. in Computer Science, Data Science, or a related technical field (or equivalent practical experience).

What Success Looks Like

• In 3 Months: Map out the existing AI/ML deployment pipeline, identify critical governance gaps, and deliver a technical roadmap for automated compliance auditing.
• In 6 Months: Launch the first version of our centralized AI Governance, enabling product teams to seamlessly integrate model tracking, bias testing, and safety guardrails into their existing CI/CD workflows.
• In 12 Months: Establish a comprehensive, real-time AI risk-monitoring dashboard that successfully scales to support all enterprise-wide AI systems, ensuring 100% compliance with relevant regulatory standards.

Pay

Base salary range: $106,200 to $182,983 annually.

Benefits

• Annual employee bonus program.
• Robust Wellness Program.
• Generous paid-time-off (PTO).
• 11 paid holidays per year, 1 floating holiday, birthday off, and 2 volunteer days.
• Excellent 401(k) Retirement Saving Plan with employer match.
• Robust employee recognition program.
• Tuition reimbursement.