Role Description
We are looking for an experienced Azure Data Engineer with 5+ years of hands-on expertise in designing, developing, and maintaining scalable data solutions on Microsoft Azure. The ideal candidate should have strong experience in Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), MS SQL Server, data modeling, and ETL/ELT pipeline development. The candidate will be responsible for building reliable data pipelines, optimizing database performance, and supporting enterprise-scale data integration initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory (ADF).
- Build and manage incremental and full-load data ingestion pipelines on Azure cloud platforms.
- Develop and maintain data solutions using Azure Data Lake Storage (ADLS).
- Create, optimize, and troubleshoot complex SQL queries, stored procedures, functions, and views in MS SQL Server.
- Perform query tuning and database performance optimization to improve processing efficiency and reduce execution time.
- Design and implement data models to support analytics, reporting, and business intelligence requirements.
- Monitor, maintain, and enhance existing Azure-based data pipelines for reliability and scalability.
- Collaborate with business analysts, data architects, and cross-functional teams to gather and understand data requirements.
- Implement version control and CI/CD best practices using Git and GitHub.
- Ensure data quality, integrity, governance, and security standards are maintained across data platforms.
- Troubleshoot production issues and provide timely resolutions for pipeline failures and data inconsistencies.
- Participate in code reviews, technical documentation, and knowledge-sharing sessions.
Required Skills
- Strong experience with Microsoft Azure cloud services.
- Hands-on expertise in Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS).
- Proficiency in MS SQL Server, including:
- Stored Procedures
- Query Optimization
- Performance Tuning
- SQL Development
- Experience in designing and developing incremental and full-load ETL pipelines.
- Strong understanding of data modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
- Experience with Git and GitHub for version control and code management.
- Good understanding of data warehousing concepts and ETL/ELT methodologies.
- Strong analytical, troubleshooting, and problem-solving skills.
- Ability to work independently and in collaborative Agile environments.
Preferred Qualifications
- Experience with Azure Synapse Analytics or Databricks is an added advantage.
- Knowledge of CI/CD pipelines and DevOps practices.
- Exposure to Power BI or reporting tools is preferred.
- Microsoft Azure certifications are a plus.
Education
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.
Requirements added by the job poster
- Bachelor's Degree
- 3+ years of work experience with Microsoft SQL Server
- 5+ years of work experience with Microsoft Azure
Pay: ₹700,000.00 - ₹1,200,000.00 per year
Work Location: Remote
