We are looking for an experienced Technology Engineer with strong expertise in Cloudera CDP, Hadoop ecosystem, DevOps, OpenShift, and CI/CD to support enterprise Technology Platforms & Data Platforms initiatives.
The ideal candidate should possess hands-on production support experience, platform engineering expertise, automation capabilities, and strong knowledge of containerized data platforms. This role requires ownership of Cloudera platform administration, performance optimization, infrastructure automation, observability, and CI/CD implementation within large-scale enterprise environments.
Requirements
Key Responsibilities
-
Provide Tier-2 production support for enterprise Cloudera CDP environments.
-
Install, configure, administer, and maintain Cloudera Data Platform (CDP) clusters.
-
Perform installation, upgrades, patching, and maintenance of CDP 7.1.9 (or latest versions).
-
Administer and support Cloudera Data Services (CDS) 1.5.4 / 1.5.5 and latest releases.
-
Enable and maintain enterprise security controls across Cloudera CDP environments.
-
Optimize Hadoop cluster performance, resource utilization, and overall platform stability.
-
Collaborate with Data Engineering teams to optimize Spark workloads and improve application performance.
-
Troubleshoot and resolve production issues related to:
-
Spark Jobs
-
Hive Jobs
-
YARN Jobs
-
Support CDP containerization using Cloudera Data Services.
-
Design, develop, and maintain infrastructure automation for platform operations.
-
Build and maintain automated CI/CD pipelines for analytics and data engineering workloads.
-
Automate infrastructure provisioning, deployment, configuration management, and operational tasks.
-
Implement observability, monitoring, logging, and alerting solutions for platform health.
-
Automate security, compliance, and regulatory validation processes.
-
Plan and execute automated patch management across enterprise environments.
-
Work closely with Infrastructure, DevOps, Security, Data Engineering, and Platform teams to ensure reliable platform operations.
-
Participate in Agile ceremonies and contribute to continuous engineering improvements.
Required Technical SkillsCloudera & Hadoop
-
Strong hands-on experience supporting Cloudera CDP production environments.
-
Experience with:
-
Cloudera Data Platform (CDP)
-
CDP 7.1.9 or latest versions
-
Cloudera Data Services (CDS) 1.5.4 / 1.5.5
-
Hadoop ecosystem administration.
-
Spark administration and performance optimization.
-
Hive administration and troubleshooting.
-
YARN administration and troubleshooting.
-
Cluster installation, upgrades, maintenance, and optimization.
DevOps & Automation
Strong experience with:
-
Ansible
-
Shell Scripting
-
Terraform
-
Groovy
-
Python automation
Experience developing infrastructure automation and operational workflows.
CI/CD
Hands-on experience building and managing automated pipelines using:
-
GitHub Actions
-
Jenkins
-
ArgoCD
Experience implementing CI/CD for data engineering and analytics workloads.
Containers & Platform Engineering
Hands-on experience with:
-
Docker
-
Podman
-
Kubernetes
-
OpenShift (OCP)
Experience deploying and managing containerized data platform environments.
Observability & Monitoring
Experience implementing:
-
Platform monitoring
-
Logging
-
Alerting
-
Observability frameworks
-
Performance monitoring
Security & Infrastructure
Experience with:
-
CDP security implementation
-
Authentication & authorization
-
Security hardening
-
Automated security checks
-
Regulatory compliance automation
-
Automated patch management
Operating Systems & Version Control
-
Linux system administration
-
Linux networking fundamentals
-
Git version control
-
Source code management best practices
Required Competencies
-
Strong production support experience within enterprise environments.
-
Excellent troubleshooting and root cause analysis skills.
-
Strong understanding of distributed data platforms.
-
Ability to optimize platform performance and reliability.
-
Strong ownership mindset with focus on operational excellence.
-
Excellent communication and stakeholder collaboration skills.
-
Ability to work effectively in Agile engineering environments.
-
Experience working across Infrastructure, DevOps, and Data Engineering teams.
-
Strong analytical and problem-solving capabilities.
Preferred Experience
-
Enterprise Data Platform Engineering.
-
Large-scale Hadoop & Cloudera environments.
-
Data Platform Operations.
-
Platform Automation & Infrastructure as Code.
-
DevOps Engineering.
-
Cloud-native platform engineering.
-
OpenShift-based enterprise deployments.
