Confluent Kafka Architect with Flink

Responsibilities

• DevOps and middleware collaboration with OCC DevOps and middleware teams.
• Deployment of Flink environments and VVP -> Flink migration.
• Understanding existing Flink jobs, dependencies, statefulness, Flink versions, jars, and required code/library changes during migration.
• Kafka + event-stream validation, including comparison of VVP vs CMF outputs, record counts, key distributions, payload equality, consumer lag, and throughput under load.
• Inventorying clusters and namespaces, creating equivalent Flink environments, and managing, scaling, monitoring, and deploying streaming dataflow jobs securely across Kubernetes clusters using the Flink Kubernetes Operator and Confluent Manager for Apache Flink.
• Knowledge transfer and addressing Helm deployments, security / authentication integration, including decisions and implementations of OAuth vs mTLS, CRBs, and MDS exposure/access patterns.
• CI/CD and automation, building harness pipelines, updating SRO/API endpoints, and validating deploy/update/rollback flows without manual in-cluster changes.
• Operations / SRE / observability, including dashboards, alerts, checkpoint health, backpressure, restart behavior, logs, savepoints, suspend/resume, and scaling parallelism.
• Migration runbook + cutover planning, including phased wave planning, shadow mode, rollback readiness, and per-app migration execution/checklists.
• State migration expertise, including state rebuild strategies and automations.
• Test management / QA, hands-on testing of pipelines, defining functional, non-functional, and operational validation criteria plus exit criteria per environment.

Qualifications

• Knowledge of Ververika ("VVP") Platform and Flink.
• Experience with Flink application engineering.
• Understanding of Kafka + event-stream validation.
• Experience with Kubernetes / platform engineering.
• Knowledge of CI/CD and automation.
• Experience with operations / SRE / observability.
• Experience with test management / QA.