Job Description
We are looking for a skilled Data Engineer with strong expertise in Azure cloud data services, Databricks, ETL/ELT processes, and big data technologies. The ideal candidate should have hands-on experience in designing, developing, and managing scalable data pipelines and cloud-based data platforms.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using Azure and Databricks technologies
- Work with Azure cloud services including Data Factory, Synapse Analytics, Databricks, and Data Lake Storage
- Implement data modelling techniques such as Star Schema, Snowflake Schema, Normalization, and Denormalization
- Develop and optimize big data processing workflows using Spark and Hadoop ecosystem technologies
- Build and maintain data integration and orchestration workflows using ETL tools
- Ensure data governance, data quality, and security best practices across data platforms
- Collaborate with cross-functional teams for requirement gathering, deployment, and support activities
- Support cloud and on-premises infrastructure environments as required
- Implement monitoring, troubleshooting, and performance optimization for data pipelines
Required Skills & Experience
Mandatory Skills
- Strong experience with:
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage
- Hands-on experience in ETL/ELT processes and data pipeline development
- Strong knowledge of Spark, Hadoop ecosystem, and Kafka
- Strong programming skills in Python and SQL
- Experience with cloud security implementations such as Azure AD, Key Vault, VPCs, and data encryption
- Experience with data modelling concepts and large-scale data processing
- Understanding of data governance and data quality practices
- Good communication, analytical, and problem-solving skills
Preferred Skills
- Experience with ETL tools such as:
- Apache Airflow
- Informatica
- Talend
- Apache NiFi
- Familiarity with Java, Scala, or R
- Experience in on-premises infrastructure or cluster management (Cloudera/Hortonworks)
- Knowledge of Linux/Windows server environments and networking concepts
Pay: ₹1,200,000.00 - ₹1,500,000.00 per year
Work Location: Remote
