Application Architect (contract)
KPMG US · Jersey City, NJ · 1 wk ago
EngineeringContract
Responsibilities
- Evaluating and testing governance and control frameworks for cutting-edge agentic AI capabilities embedded within Databricks.
- Auditing the Unity Catalog governance layover and exact configuration of Databricks AI agentic systems.
- Focusing on Unity Catalog access controls, lineage, and permissioning within Databricks architecture.
- Understanding and assessing data lifecycle governance within Databricks.
- Assessing agent-based systems such as Large Language Models (LLMs), orchestration, and workflows.
- Evaluating agent behavior, outputs, and associated risks.
- Experiencing the AI development lifecycle from training to deployment and monitoring.
- Developing or using AI risk frameworks and Risk Control Matrix (RCM).
- Performing AI control testing and validation beyond traditional Information Technology General Controls (ITGCs).
Qualifications
- Unity Catalog governance (access controls, lineage, permissioning)
- Databricks architecture (data ingestion, transformation, ML/GenAI pipelines)
- Experience with Databricks ML / GenAI capabilities and workflows
- Understanding of data lifecycle governance within Databricks
- Understanding of agent-based systems (LLMs, orchestration, workflows)
- Experience evaluating agent behavior, outputs, and risks
- Knowledge of AI development lifecycle (training, deployment, monitoring)
- Familiarity with AI governance concepts (bias, explainability, monitoring, HITL)
- Experience performing AI control testing and validation (not just ITGCs)
- Experience developing or using AI risk frameworks / RCM