DevOps + Databricks Engineer
Experience: 6+ Years
Location: Chennai & Pune
Work Mode: Hybrid – 3 days working from office
Budget: Up to 19 LPA
Payroll: Haparz
Notice Period: Immediate / Short Notice preferred
Mandatory: Strong DevOps + Databricks experience
Role Overview
We are looking for an experienced DevOps + Databricks Engineer to build and manage secure, scalable, and production-ready cloud environments. The role will focus on AWS infrastructure, infrastructure automation, CI/CD, Databricks platform enablement, security, monitoring, and reliable deployment of data and AI workloads.
Key Responsibilities
- Establish and manage development, testing, staging, and production-ready cloud environments on AWS.
- Build infrastructure-as-code solutions and automate environment provisioning using Terraform, CloudFormation, or equivalent tools.
- Design and maintain CI/CD pipelines for Python services, data pipelines, analytical workloads, and Databricks deployments.
- Implement deployment gates, release controls, environment promotion, rollback, and recovery procedures.
- Manage Databricks workspace enablement, Unity Catalog, access management, secrets, networking, and platform monitoring.
- Configure and maintain AWS infrastructure required for PRODIGY and related enterprise services.
- Implement IAM, enterprise authentication, secrets management, and appropriate access controls.
- Establish centralized logging, metrics, alerting, audit trails, and operational dashboards.
- Implement security scanning, dependency management, secrets protection, and compliance controls.
- Support performance optimization, availability, backup, disaster recovery, and production-readiness activities.
- Collaborate with developers, data engineers, ML engineers, and QA teams to improve build, testing, and deployment automation.
- Troubleshoot infrastructure, deployment, Databricks, networking, and production issues and drive them to resolution.
Candidate Profile
- 6+ years of experience in DevOps, Cloud Engineering, Platform Engineering, or a closely related role.
- Strong hands-on experience with AWS and production cloud infrastructure.
- Strong hands-on experience with Databricks administration and deployment automation.
- Practical experience with Unity Catalog, Databricks access management, secrets, and workspace configuration.
- Strong Infrastructure-as-Code experience using Terraform, CloudFormation, or equivalent.
- Experience building and managing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, or similar platforms.
- Good knowledge of Docker and container orchestration.
- Strong understanding of cloud networking, IAM, monitoring, logging, security, and secrets management.
- Understanding of Python applications, data engineering pipelines, and ML/AI deployment workflows.
- Experience working with enterprise platforms where security, compliance, availability, and operational controls are important.
- Familiarity with Azure AD / Microsoft Entra ID and cross-cloud integrations is an advantage
Work Location: Hybrid remote in Pune, Maharashtra
