Senior Cloud Engineer – Azure Data & AI Platform
Role Overview
We are seeking a Senior Cloud Engineer to design, implement, and manage the Azure infrastructure powering our Data & AI platform, with a focus on Azure Databricks, ADLS Gen2, Azure Data Factory, and Azure Machine Learning.
The role owns IaC, networking, security, identity, governance, observability, CI/CD, and cost optimization, while serving as the technical partner to Data Engineering, Data Science, and Databricks teams.
Key Responsibilities
- Build and manage Azure infrastructure using Terraform and reusable IaC modules.
- Design secure Azure networking and identity architecture, including VNets, private endpoints, NSGs, RBAC, Managed Identities, and Key Vault.
- Manage ADLS Gen2 architecture, access controls, lifecycle, encryption, and storage optimization.
- Administer Azure Databricks, including workspaces, Unity Catalog, cluster policies, identity federation, and multi-workspace strategy.
- Implement monitoring and observability using Azure Monitor, Log Analytics, diagnostics, and alerting.
- Own CI/CD and environment management across development, testing, and production.
- Drive FinOps, cost visibility, DBU optimization, tagging, budgeting, and capacity planning.
- Develop platform automation using Python, PowerShell, and/or Bash.
- Troubleshoot cross-platform issues involving infrastructure, Databricks, networking, permissions, and workloads.
- Establish platform standards, reference architectures, and self-service patterns for engineering teams.
Mandatory Skills
- Expert-level Terraform and production-grade IaC/CI/CD experience.
- Hands-on Azure Databricks Administration and Unity Catalog.
- Strong Azure Networking & Security expertise.
- Strong ADLS Gen2 enterprise architecture experience.
- Azure Data Factory platform/infrastructure experience.
- Entra ID, RBAC, Managed Identities, Key Vault.
- Strong Python and scripting skills.
- Working knowledge of Spark and SQL for troubleshooting and performance diagnostics.
- Strong stakeholder management and technical leadership skills.
Good to Have
- Databricks Asset Bundles and Terraform Databricks Provider.
- Azure Machine Learning / MLflow.
- Kubernetes / AKS.
- Policy-as-Code: Azure Policy, OPA, Sentinel, Checkov.
- Event Hubs, Kafka, or Stream Analytics.
- FinOps experience.
- Multi-region / multi-tenant Databricks environments.
- Relevant Databricks, Azure, and Terraform certifications.
Pay: ₹120,000.00 - ₹150,000.00 per month
Benefits:
Application Question(s):
- Are you willing to share PAN/Aadhar for the background verification (BGV) process ?
- Are you currently employed anywhere? If so, How will you manage this new opportunity?
- Would you be comfortable working from the *Trivandrum/Kochi office for the first week, after which the role will be fully remote, with travel and accommodation expenses covered by the company* for the first week?
- Client would require UAN for interview process once profile gets shortlisted. Are you fine with that?
- Are you fine with 3:30 PM IST to 11:30 PM IST Shift timing?
- This is a CONTRACTUAL JOB for 6 MONTHS currently. Are you comfortable with it?
Experience:
- Azure: 4 years (Required)
- Terraform: 3 years (Required)
Work Location: Remote
