About the Role
We are looking for a highly skilled Senior Data Engineer with strong expertise in SQL, Azure Data Factory, Databricks, and ETL development. The ideal candidate should have experience designing and building scalable data pipelines, optimizing data workflows, and working directly with business stakeholders to deliver robust data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines using Azure Data Factory and Azure Databricks.
- Develop, optimize, and troubleshoot SQL queries, stored procedures, and database objects in SQL Server.
- Build and maintain data warehouse solutions using dimensional modeling techniques such as Star Schema, Facts, and Dimensions.
- Implement efficient Spark-based data transformations for large-scale data processing.
- Work with Databricks Unity Catalog for centralized data governance and secure data access.
- Collaborate with business users to gather requirements and translate them into technical solutions.
- Participate in the complete software development lifecycle, including development, testing, deployment, and maintenance.
- Write and review test cases to ensure high-quality code delivery.
- Use Azure DevOps, source control, and CI/CD pipelines for application lifecycle management.
- Estimate project timelines, manage deliverables, and provide technical recommendations to clients.
Required Skills
- Strong experience with SQL Server and relational databases.
- Hands-on experience with Azure Data Factory (ADF) and Azure Databricks.
- Good understanding of ETL concepts and data integration.
- Experience with Airflow or similar workflow orchestration tools.
- Strong knowledge of Data Warehousing, Dimensional Modeling, and Star Schema.
- Experience working with Azure DevOps, Git/Source Control, and CI/CD.
- Ability to communicate effectively with business stakeholders and clients.
- Experience working across the complete SDLC.
Pay: ₹800,000.00 - ₹1,000,000.00 per year
Benefits:
- Flexible schedule
- Food provided
- Provident Fund
Work Location: In person
