Kafka Administrator / Confluent Kafka Engineer
Experience: 4.5 – 6 Years
Location: Bangalore (Hybrid – 3 Days WFO)
Employment Type: Direct Contract with Haparz
Budget: Up to 18 LPA
Shift: General Shift
Job Summary
We are looking for an experienced Confluent Kafka Administrator to manage, optimize, and support enterprise-scale Kafka streaming platforms. The ideal candidate should have strong expertise in Confluent Kafka administration, cluster management, monitoring, security, performance tuning, and event-driven architecture.
The candidate will be responsible for ensuring high availability, scalability, reliability, and security of Kafka environments while collaborating with development and integration teams to support real-time data streaming solutions.
Key ResponsibilitiesKafka Platform Administration
- Install, configure, and administer Confluent Kafka clusters.
- Manage Kafka Brokers, ZooKeeper, Schema Registry, Kafka Connect, ksqlDB, Control Center, and REST Proxy.
- Monitor Kafka environments using Prometheus, Grafana, Dynatrace, or similar tools.
- Implement proactive alerting, logging, and health monitoring.
- Perform Kafka cluster upgrades, maintenance, and patching.
- Ensure high availability, scalability, and fault tolerance of Kafka infrastructure.
- Conduct capacity planning and performance optimization.
- Design and maintain disaster recovery and backup strategies.
Development & Integration
- Create and manage Kafka topics, partitions, producers, and consumers.
- Develop and maintain Kafka Connect integrations.
- Build streaming pipelines connecting enterprise applications and databases.
- Implement schema governance using Confluent Schema Registry.
- Work with Avro, JSON, and Protobuf serialization formats.
- Support event-driven architecture initiatives across the organization.
- Collaborate with application teams to troubleshoot Kafka-related issues.
Security & Governance
- Configure Kafka security using RBAC, ACLs, TLS, SASL, and OAuth.
- Implement data governance and retention policies.
- Manage audit logging and compliance requirements.
- Ensure secure communication across Kafka components.
Work Location: Hybrid remote in Bangalore City, Bengaluru, Karnataka