Applied AI Platform & DevOps Engineer

About the role

CohnReznick is seeking an Applied AI Platform & DevOps Engineer Senior Manager to join the Strategic AI team. This role is remote and requires ownership of AI-native environments, CI/CD pipelines, hosting, reliability, availability, and security for AI-enabled platforms and applications.

Responsibilities

• Own AI-Native Environments & CI/CD
• Design, implement, and operate end-to-end CI/CD pipelines for AI-enabled platforms and applications.
• Manage versioning, promotion, and rollback of:
• Embed AI-aware testing into CI/CD.
• Implement safe deployment patterns (canary, shadow, feature flags).
• Own Hosting & Runtime for Strategic AI Applications
• Own the hosting and execution environment for AI services (APIs, background jobs, agents, workflows).
• Design and operate inference orchestration patterns (managed APIs, hybrid or local models as needed).
• Implement reliability mechanisms: caching, batching, retries, fallbacks, circuit breakers.
• Partner with core infrastructure teams, while retaining ownership of the AI runtime layer.
• Reliability, Availability, and Security of AI Systems
• Define and enforce Service Level Objectives (SLOs)/Service Level Agreements (SLAs) for AI platforms and applications.
• Build and maintain AI-specific observability, including:
• Own security implementation for AI systems.
• Ensure AI platforms meet enterprise security, privacy, and compliance standards.
• AI-Native Software Development Lifecycle
• Embed AI capabilities directly into the SDLC.
• Define standards for how Strategic AI builds, reviews, deploys, and operates AI software.
• Continuously improve tooling and workflows to reduce manual effort and operational risk.
• Platform & Tooling Development
• Create “golden paths” for common AI patterns (e.g., RAG, agent workflows, orchestration).
• Reduce friction for Applied AI Engineers by providing reliable, well-documented infrastructure and tooling.

Qualifications

• 6+ years of experience in DevOps, Platform Engineering, SRE, or Backend Engineering, with ownership of production systems.
• Strong hands-on coding experience (e.g., Python, TypeScript/Node.js, Java, or C#).
• Deep experience with CI/CD, environment management, and infrastructure automation.
• Proven experience owning production hosting, reliability, and availability for distributed systems.
• Strong understanding of authentication, authorization, and secure service integration.
• Comfort being accountable for operational outcomes in production environments.

Preferred Qualifications

• Experience operating AI-enabled applications in production (LLMs, RAG, agentic workflows).
• Familiarity with retrieval systems, embeddings, and vector databases.
• Experience implementing observability and runtime controls beyond basic infrastructure metrics.
• Experience working in regulated or security-conscious environments.

Pay

Compensation is competitive and commensurate with experience.

Schedule

The position is considered remote, allowing flexibility in work hours and location.