LEAD CONFLUENT KAFKA ENGINEER

About the role

We are seeking a Lead Consultant – Confluent Kafka to lead Kafka platform administration, troubleshooting, maintenance, automation, and production support. The role requires strong Confluent Kafka expertise, client-facing communication, and team leadership experience.

Responsibilities

• Administer and support Confluent Platform and Confluent Cloud environments.
• Troubleshoot Kafka connectivity, consumer groups, consumer lag, serialization, permissions, and AVRO schema issues.
• Monitor Kafka using Datadog, Prometheus, Conduktor, and related observability tools.
• Manage Kafka components including Replicator, Connectors, ZooKeeper, and KSQL.
• Automate Kafka administration using Terraform and CI/CD/DevSecOps practices.
• Manage Kafka configurations, including users, ACLs, topics, connectors, and application configurations.
• Perform platform upgrades, patching, certificate renewals, and vulnerability remediation.
• Troubleshoot Kafka client applications built with Java, .NET, Python, and Spring Boot.
• Maintain and execute DR runbooks in accordance with security and risk requirements.
• Collaborate with product and application teams on releases, documentation, enhancements, and automation.
• Coordinate with Confluent or cloud providers to resolve platform issues.
• Lead and mentor team members and communicate effectively with clients and stakeholders.
• Support AutoSys, including agent installation, maintenance, patching, upgrades, and service checkouts.

Required Skills & Experience

• 10+ years of IT experience with strong Kafka platform experience.
• Hands-on experience with Confluent Kafka / Confluent Platform / Confluent Cloud.
• Strong Kafka administration, troubleshooting, and production support experience.
• Experience with Kafka monitoring and observability tools such as Datadog, Prometheus, and Conduktor.
• Experience with Terraform, CI/CD, and DevSecOps.
• Strong understanding of Kafka security, ACLs, topics, connectors, schemas, and consumer groups.
• Experience with DR, patching, upgrades, certificates, and vulnerability remediation.
• Experience troubleshooting Java, .NET, Python, and Spring Boot Kafka applications.
• Strong client-facing, team leadership, and communication skills.