We are seeking an Azure Data Platform Engineer with a strong focus on Administration and hands-on experience in Azure platform engineering services.
Ideal candidates should have expertise in administering services such as:
· Azure Data Factory (Administration)
· Azure Synapse Analytics (Administration)
· Azure Databricks (Administration)
· Cosmos DB (Administration)
· Azure Key Vault
· Function App & Logic App
· Azure Data Lake Storage (ADLS)
· App Services
· Event Hub
· Azure Monitor & Log Analytics
· Capacity planning of Azure resources
· Azure DevOps & CI/CD pipelines
· Provisioning of Azure resources
· Python / Shell scripting
· Monitoring, and troubleshooting of Azure resources
· Azure Kubernetes Service (AKS)
· Provisioning of VNet and subnet and creating service endpoints & private endpoints.
· Additional knowledge of Tableau and Power BI would be a plus.
Also, candidates should have hands-on experience managing and ensuring the stability, security, and performance of these platforms, with a focus on automation, monitoring, and incident management.
· Proficient in distributed system architectures and Azure Data Engineering services like Event Hub, Data Factory, ADLS Gen2, Cosmos DB, Synapse, Databricks, APIM, Function App, Logic App, and App Services
· Implement, and manage infrastructure using IaC tools such as Azure Resource Manager (ARM) templates and Terraform.
· Manage containerized applications using Docker and orchestrate them with Azure Kubernetes Service (AKS).
· Set up and manage monitoring, logging, and alerting systems using Azure Monitor, Log Analytics, and Application Insights.
· Implement disaster recovery (DR) strategies, backups, and failover mechanisms for critical workloads.
· Automate infrastructure provisioning, scaling, and management for high availability and efficiency.
· Experienced in managing and maintaining clusters across Development, Test, Preproduction, and Production environments on Azure.
· Skilled in defining, scheduling, and monitoring job flows, with proactive alert setup.
· Adept at troubleshooting failed jobs in azure tools like Databricks and Data Factory, performing root cause analysis, and applying corrective measures.
· Hands-on experience with distributed streaming tools like Event Hub.
· Expertise in designing and managing backup and disaster recovery solutions using Infrastructure as Code (IaC) with Terraform.
· Strong experience in automating processes using Python, shell scripting, and working with Jenkins and Azure DevOps.
· Proficient in designing and maintaining Azure CI/CD pipelines for seamless code integration, testing, and deployment.
· Experienced in monitoring and troubleshooting VM resources such as memory, CPU, OS, storage, and network.
· Skilled at monitoring applications and advising developers on improving job and workflow performance.
· Capable of reviewing and resolving log file issues for system and application components.
· Adaptable to evolving technologies, with a strong sense of responsibility and accomplishment.
· Knowledgeable in agile methodologies for software delivery.
· Experience with Azure and cloud platforms, leveraging cloud-native tools to build, manage, and optimize secure, scalable solutions.
Pay: ₹100,000.00 - ₹120,000.00 per month
Benefits:
Experience:
- data Engineer: 6 years (Preferred)
- Overall: 7 years (Preferred)
Work Location: Remote
