Job Overview
We are looking for an experienced Azure Data Engineer with 8-10 years of experience to join our team. The suitable candidate should possess strong expertise in Azure data engineering components and be capable of translating business requirements into scalable technical solutions.
Roles & Responsibilities
- Collaborate with business stakeholders, analysts, and architects to understand data requirements and translate them into scalable technical solutions.
- Design, develop, and maintain reliable data pipelines using Azure services such as Azure Data Factory and Databricks.
- Build and enhance data ingestion frameworks supporting structured and unstructured data from multiple source systems.
- Implement complex data transformations using PySpark, SQL, and Python for large-scale data processing.
- Work with an enterprise Lakehouse for efficient data storage, organization, and performance optimization.
- Monitor and troubleshoot pipeline failures, data quality issues, and performance bottlenecks to ensure operational stability.
- Address production issues by analyzing problems, coordinating with business users and internal teams, and ensuring timely resolution.
Skills & Experience
The following skills and experiences are necessary to succeed in this role:
- 8–10 years of experience in Data & Analytics, including 5+ years of hands-on Azure data engineering experience.
- Strong hands-on expertise in Python, SQL, and PySpark.
- Solid understanding of ETL/ELT concepts and Azure data engineering components.
- Strong knowledge of data transformations, validation, error handling, ingestion patterns, and query optimization in SQL and Spark.
- Good communication and collaboration skills, with the ability to work effectively with both business and technical stakeholders.
Pay: ₹1,200,000.00 - ₹2,500,000.00 per year
Work Location: Remote