CDH & Kafka Expert

BMW TechWorks India
Pune, Maharashtra

Apply Now

Job details

Qualifications

Performance tuning
HDFS
Incident management
Software troubleshooting
Big data
DevOps
Encryption
Apache Hive
Analysis skills
Distributed systems
Scripting
Linux
Kafka
Python
Hadoop

Full job description

Skills

Skill

Minimum Qualification

No data available

Job Description

Role

CDH & Kafka Expert

Visit our website bmwtechworks.in to know more.

Experience:

Years of exp. Needed for the requirement (e.g. 4 – 8 Years)

Number of openings

What awaits you/ Job Profile

Platform Operations & Management: Operate and manage Cloudera Data Hub (CDH) and Apache Kafka platforms to ensure high availability, reliability, and performance of enterprise data systems. Kafka Cluster Administration: Administer Kafka clusters including broker management, topic configuration, partitioning, replication strategies, and lifecycle management. Monitoring & Incident Handling: Monitor platform health, identify anomalies, and troubleshoot issues across CDH and Kafka components to ensure minimal service disruption. Performance & Capacity Optimization: Analyze workloads and optimize system performance, throughput, and resource utilization across distributed data platforms. Security Management: Ensure secure operations by implementing enterprise security standards including authentication, authorization, encryption, and auditing. Operational Excellence: Identify opportunities for operational improvements and automation to enhance platform stability and efficiency. Documentation & Collaboration: Maintain accurate documentation of configurations, operational procedures, and troubleshooting guidelines; collaborate with data engineering, application, and infrastructure teams.

What should you bring along

Strong understanding of big data platforms and distributed systems. Hands-on experience with Cloudera Data Hub (CDH) and Hadoop ecosystem components. Practical experience operating Apache Kafka in production environments. Solid knowledge of Linux-based systems and enterprise IT operations.

Must have technical skill

Proven experience in administering CDH / Hadoop

ecosystems (HDFS, YARN, Hive, Impala).

Strong expertise in Apache Kafka operations and

troubleshooting.

Experience with monitoring, alerting, and incident

management in large-scale platforms.

Knowledge of security concepts such as Kerberos, Ranger, TLS, and access control. Strong analytical and problem-solving skills to identify root causes and implement effective solutions.

Good to have Technical skills

Experience with Kafka Connect, Kafka Streams, or streaming architectures. Exposure to cloud or hybrid data platforms. Automation and scripting experience (e.g., Shell, Python). Experience with capacity planning and performance tuning. Familiarity with DevOps / SRE practices in data platform operations. Ability to work effectively in cross-functional, enterprise environments.

Apply Now

Jobseeker tools

Employer Tools

Browse

Stay Connected