Data Engineer Bangalore · Full-time · Hybrid
About the Role We are seeking a skilled Data Engineer to design, build, and maintain scalable data solutions on the Azure platform, playing a key role in developing robust data pipelines and contributing to enterprise-wide analytics initiatives. The ideal candidate will ensure data quality and deliver data-driven insights and solutions. The role involves collaboration with various teams, including DevOps, Data Science, and Business Intelligence.
Key Responsibilities
- Design and develop scalable data pipelines using Spark SQL and PySpark on Azure Databricks
- Build and orchestrate ETL workflows using Azure Data Factory (ADF)
- Develop and maintain a modern Lakehouse architecture leveraging ADLS and Databricks
- Perform data preparation tasks including data cleaning, normalization, deduplication, and data type transformations
- Collaborate with DevOps teams to deploy and manage solutions in production environments
- Monitor data pipelines, identify issues, and implement corrective actions, including root cause analysis and resolution
- Contribute to the global Analytics team, delivering data-driven insights and solutions
- Collaborate with Data Science and Business Intelligence teams to share best practices and drive innovation
- Lead data engineering projects and support cross-functional initiatives led by other team members
- Apply change management practices, including documentation, communication, and training, to support system upgrades and data migrations
Requirements
- Have minimum 5 years of experience in Data Engineering
- Possess strong experience with the Azure ecosystem (Azure Databricks, Azure Data Factory, ADLS)
- Demonstrate proficiency in PySpark and Spark SQL
- Have a solid understanding of ETL processes and data pipeline development
- Possess advanced SQL skills
