Integration Engineer

Roles & Responsibilities

• Design, develop, and support scalable integration solutions using Java, Spring Boot, Apache Kafka, and streaming technologies.
• Build and support real-time event-driven architectures to enable seamless data exchange across enterprise applications.
• Develop high-performance Kafka producers, consumers, and stream processing applications.
• Design and implement integration APIs, microservices, and messaging solutions to support business processes.
• Create and manage Kafka topics, partitions, consumer groups, schema registries, and retention policies.
• Develop and maintain real-time data pipelines for data ingestion, transformation, and distribution.
• Ensure integrations meet performance, scalability, reliability, and security requirements.
• Integrate enterprise systems, cloud platforms, databases, and third-party applications using APIs and messaging frameworks.
• Develop RESTful services and event-based integration patterns to support application interoperability.
• Implement data transformation, validation, and routing logic across integration flows.
• Support batch and streaming data processing requirements.
• Design and implement streaming solutions using Kafka Streams, Spark Streaming, or similar technologies.
• Monitor and optimize Kafka clusters for throughput, availability, and fault tolerance.
• Troubleshoot messaging, latency, and performance issues within streaming environments.
• Implement dead-letter queues (DLQs), retry mechanisms, and fault-tolerant processing patterns.
• Define topic strategies, partitioning schemes, and event schemas to support business requirements.
• Develop and support CI/CD pipelines for integration and streaming applications.
• Build containerized applications using Docker and deploy on Kubernetes/OpenShift platforms.
• Automate deployment, monitoring, and operational processes.
• Participate in infrastructure and environment provisioning activities.