Job Description
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Develop and optimize data processing solutions using Azure Synapse Analytics.
- Build data transformation workflows using PySpark.
- Develop and optimize complex SQL queries, stored procedures, and data models.
- Work with Azure Data Lake Storage (ADLS Gen2) for large-scale data ingestion and storage.
- Design and maintain robust data integration solutions across multiple data sources.
- Ensure data quality, validation, monitoring, and pipeline reliability.
- Optimize performance, scalability, and cost of Azure data solutions.
- Collaborate with Data Architects, BI Developers, Data Scientists, and business stakeholders.
- Support data warehouse implementation and dimensional data modeling.
- Troubleshoot production issues and provide timely resolutions.
- Follow best practices for data security, governance, and documentation.
Technical Skills Required
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- 7–10 years of experience as a Data Engineer.
- Strong hands-on experience with Azure Data Factory (ADF).
- Strong experience in Azure Synapse Analytics.
- Hands-on experience with PySpark.
- Excellent SQL programming and query optimization skills.
- Experience with Azure Data Lake Storage (ADLS Gen2).
- Strong understanding of ETL/ELT development.
- Experience with Data Warehousing concepts and dimensional modeling.
- Experience handling structured, semi-structured, and large-scale datasets.
- Strong analytical, troubleshooting, and communication skills.
Nice to Have
- Azure Databricks.
- Delta Lake.
- Azure DevOps & CI/CD.
- Power BI integration.
- Python scripting.
- Microsoft Azure Data Engineer Certification.
Pay: ₹80,000.00 - ₹100,000.00 per month
Work Location: Remote
