Job Title: Azure Databricks Data Engineer (Python, PySpark, SQL)
Location: Bengaluru / Hyderabad
Experience: 7–15 Years
Notice Period: Immediate Joiners or Serving Notice Period Preferred
Key Responsibilities
- Design and build scalable data pipelines on Azure for batch and distributed data processing.
- Develop data transformation frameworks using Python and PySpark.
- Work with Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage (ADLS) for large-scale data engineering solutions.
- Write, optimize, and maintain complex SQL queries for high performance and reliability.
- Implement data quality checks, validation, and monitoring for production data pipelines.
- Optimize Spark workloads through tuning, partitioning, caching, and efficient storage formats (Delta Lake, Parquet, etc.).
- Collaborate with Data Science, BI, and Platform Engineering teams in an Agile development environment.
- Troubleshoot production issues and drive continuous improvements in data pipelines and platform performance.
Rekha.C@eagledrift.com
Pay: ₹500,000.00 - ₹2,400,000.00 per year
Work Location: In person
