Job Summary
We are looking for an experienced Lead Fabric Data Engineer to design, develop, and implement scalable data engineering solutions using Microsoft Fabric for our Industrial Gas project.
The ideal candidate will have strong hands-on expertise in Microsoft Fabric, OneLake, Lakehouse, Data Factory, Data Warehouse, Spark/PySpark, SQL, and Power BI. You will be responsible for building robust data pipelines, implementing Medallion Architecture, optimizing data processing workloads, and ensuring high-quality, secure, and reliable data solutions.
You will work closely with architects, business stakeholders, data engineers, and analytics teams to deliver enterprise-grade data platforms and analytics solutions.
Roles & Responsibilities
- Design, develop, and implement scalable data engineering solutions using Microsoft Fabric and OneLake.
- Build and maintain end-to-end data pipelines using Fabric Data Factory, Pipelines, and Dataflows Gen2.
- Develop data ingestion and transformation processes across structured and semi-structured data sources.
- Implement Medallion Architecture (Bronze, Silver, and Gold) using Fabric Lakehouse.
- Develop and optimize PySpark/Spark notebooks for large-scale data processing and transformation.
- Design and implement data models and curated datasets for analytics and reporting.
- Develop solutions using Fabric Data Warehouse and T-SQL for analytical workloads.
- Work with Delta Lake and optimize storage, partitioning, and data processing strategies.
- Implement incremental data loads, slowly changing dimensions, data quality checks, and error-handling frameworks.
- Integrate data from multiple sources including Azure, SQL Server, APIs, files, and legacy data platforms.
- Optimize pipeline performance, Spark workloads, SQL queries, and Fabric capacity utilization.
- Implement and maintain CI/CD pipelines, Git integration, and deployment processes for Fabric artifacts.
- Work with Azure DevOps/GitHub to manage source code, releases, and development workflows.
- Implement appropriate data security, access controls, and workspace-level governance.
- Collaborate with Power BI developers and analytics teams to provide optimized datasets and Semantic Models.
- Troubleshoot production issues, perform root-cause analysis, and ensure timely resolution.
- Participate in architecture discussions, code reviews, technical design sessions, and solution walkthroughs.
- Mentor junior and mid-level data engineers and promote data engineering best practices.
- Ensure solutions meet performance, scalability, reliability, security, and data quality standards.
Required Skills & Qualifications
- 6–8 years of experience in Data Engineering, Data Development, or related data technology roles.
- 2+ years of hands-on experience with Microsoft Fabric or strong experience in Azure data platforms with practical Fabric implementation experience.
- Strong hands-on experience with Microsoft Fabric and OneLake.
- Expertise in Fabric Data Factory, Data Pipelines, Dataflows Gen2, Lakehouse, and Data Warehouse.
- Strong experience with PySpark/Spark and Python for large-scale data processing.
- Strong proficiency in SQL/T-SQL and experience developing complex queries and transformations.
- Good understanding of Delta Lake and Medallion Architecture.
- Experience implementing Bronze, Silver, and Gold data layers.
- Strong understanding of ETL/ELT development and data integration patterns.
- Experience working with structured and semi-structured data sources.
- Hands-on experience with Azure Data Factory and/or Azure Synapse Analytics is preferred.
- Experience with Power BI and Semantic Models is an added advantage.
- Knowledge of Direct Lake and Fabric performance optimization is preferred.
- Experience with Git, Azure DevOps, CI/CD, and Fabric deployment pipelines.
- Good understanding of data security, access controls, data governance, and workspace management.
- Experience with data quality, monitoring, logging, and production support.
- Strong analytical and problem-solving skills.
- Good communication and collaboration skills.
- Ability to work independently as well as lead and mentor technical team members.
What You Will Do
As a Lead Fabric Data Engineer, you will play a key role in building and modernizing enterprise data platforms using Microsoft Fabric. You will work on challenging data engineering problems, develop scalable cloud data solutions, and contribute to the successful delivery of modern analytics capabilities for our clients.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.
