Jobs · New Jersey

Application Architect - AI Integration

IBM · Paramus, NJ · 1 mo ago
HybridFull-time

About the role

As an Application Architect for AI Integration, this role is responsible for designing and governing end-to-end architectures that embed AI capabilities into enterprise applications and workflows. The Application Architect collaborates with stakeholders to translate business objectives into scalable designs, balancing vendor-managed services with custom development, and drives governance for AI integration.

Responsibilities

  • Designing Architectures: defining reference patterns for AI services, models, and orchestration layers to integrate seamlessly with existing systems, APIs, and data platforms.
  • Collaborating with Stakeholders: translating business objectives into scalable, resilient, and policy-compliant designs, ensuring performance, security, compliance, and cost objectives are met.
  • Governing AI Integration: driving governance for prompts, guardrails, and lifecycle management, ensuring observability, privacy, and responsible AI principles are embedded from design through operations.

Required Technical And Professional Expertise

  • Core Architecture: 12+ years of enterprise application architecture experience, with at least 3 years in a lead or principal architect role owning cross-domain target-state design
  • Proven experience defining: microservices, event-driven (Kafka/SQS/EventBridge), and API-first architectures at scale — including versioning, lifecycle governance, and breaking-change management
  • AWS cloud architecture: (Solutions Architect Professional or equivalent depth) — EKS, RDS/Aurora, API Gateway, Lambda, SQS/SNS, MSK, and AI/ML services (Bedrock, SageMaker)
  • Data architecture experience: OLTP/OLAP separation, CDC patterns, data domain ownership, master data management, and real-time vs. batch pipeline design
  • AI & Agentic Architecture: Hands-on architecture experience designing systems that embed AI capabilities — RAG pipelines, LLM orchestration (LangChain, LlamaIndex, or equivalent), and agentic workflow patterns
  • Experience integrating AI/ML models into production enterprise systems: including model serving, prompt governance, output guardrails, and cost/latency management
  • Familiarity with AI governance frameworks: responsible AI principles, explainability requirements, audit trails for AI-assisted decisions — particularly in regulated industries
  • Experience evaluating and selecting AI services: (managed APIs vs. self-hosted models) based on data privacy, compliance, and total cost of ownership constraints
  • Domain & Regulatory: Financial services or insurance domain experience — understanding of policy lifecycle, commission structures, agent licensing, or carrier integration is strongly preferred
  • Experience designing systems that operate under regulatory frameworks: FINRA, FSRA, SOC 2, GLBA, CCPA, or equivalent — with audit logging, data retention, and access control as first-class architecture concerns
  • Technical Leadership: Demonstrated ability to drive architecture decisions through ambiguity — producing clear documentation, facilitating design reviews, and building consensus across engineering and business stakeholders
  • Experience working in Agile/scaled delivery environments: integrating architecture practice into sprint cadence without becoming a bottleneck
  • Track record of mentoring senior engineers and establishing architecture standards that teams adopt and maintain

Preferred Technical And Professional Experience

  • Experience with agent/broker distribution platforms, MLM commission hierarchies, or multi-carrier insurance marketplaces
  • Familiarity with ACORD standards, NIPR/Sircon integrations, or DTCC financial messaging
  • Experience with Valkey/Redis, Kafka, or distributed caching architecture in high-availability Kubernetes environments
  • Prior experience in a consultancy or systems integrator context — ability to operate as a trusted advisor alongside a client engineering team

Similar jobs