Role description
We are seeking a Senior DevOps Engineer with strong expertise in Apache Kafka and Apache NiFi to design, deploy, optimize, and support enterprise-scale data streaming and ingestion platforms. The role involves managing highly available data infrastructure, implementing automation and CI/CD practices, supporting cloud-native deployments, and ensuring platform reliability, scalability, security, and performance across AWS or Azure environments.
Key Responsibilities
- Design, deploy, administer, and optimize Apache Kafka clusters for high-throughput and low-latency data streaming workloads.
- Build, manage, and enhance Apache NiFi data flows to support scalable and reliable data ingestion and processing.
- Monitor, troubleshoot, and resolve production issues related to Kafka brokers, consumer lag, replication, cluster performance, and NiFi data flows.
- Implement and support CI/CD pipelines for application and infrastructure deployments.
- Deploy and operate data platform components in AWS or Azure cloud environments.
- Automate operational processes, platform provisioning, deployment, and maintenance activities.
- Ensure high availability, disaster recovery readiness, security, and operational excellence across data platforms.
- Collaborate with engineering and platform teams to improve scalability, reliability, and performance.
- Perform capacity planning, platform upgrades, monitoring, and incident resolution.
- Mentor team members and promote best practices for enterprise data platform operations.
Required Skills
Proficient
- Kafka
- Nifi
- Apigee
- Redis
- AWS or Azure
- CICD
Experience
- 5 to 6 years of overall DevOps or Platform Engineering experience.
- Minimum 3 years of hands-on production experience with Apache Kafka.
- Minimum 3 years of hands-on production experience with Apache NiFi.
Why Join UST
- Work on large-scale digital transformation and data platform initiatives.
- Collaborate with global technology teams delivering innovative enterprise solutions.
- Gain exposure to modern cloud, automation, and platform engineering practices.
- Access continuous learning opportunities, professional growth, and career advancement within a technology-driven organization.
Skills
Kafka/ Nifi/ Apigee/ Redis, AWS/ Azure, CICD
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.
