Key responsibilities
-
Lead end-to-end design and delivery of Microsoft Fabric and Azure data-engineering solutions.
-
Convert business and non-functional requirements into scalable technical designs.
-
Define Lakehouse, Warehouse, medallion, data-domain, and serving-layer architecture.
-
Design ingestion frameworks covering batch, incremental, CDC, API, and streaming patterns.
-
Establish standards for notebooks, pipelines, SQL development, naming, logging, error handling, and testing.
-
Optimize Fabric capacity consumption, Spark processing, SQL workloads, pipelines, and Power BI performance.
-
Design secure access patterns using Microsoft Entra ID, managed identities, service principals, Key Vault, and role-based access controls.
-
Implement Git integration, deployment pipelines, CI/CD, environment configuration, and release controls.
-
Lead code reviews, technical troubleshooting, root-cause analysis, and performance remediation.
-
Guide migration from Azure Synapse, Azure Data Factory, Power BI, Databricks, or legacy data platforms to Fabric.
-
Mentor Level 1 and Level 2 engineers and conduct technical enablement sessions.
-
Collaborate with architects, security teams, DevOps teams, product owners, and client stakeholders.
-
Produce solution designs, technical specifications, deployment documents, and operational runbooks.
Mandatory technical skills
-
Strong hands-on expertise in Azure data engineering and Microsoft Fabric.
-
Advanced SQL, Python, and PySpark development skills.
-
Strong experience with Lakehouse, One Lake, Delta Lake, Data Factory, Fabric Warehouse, and Power BI integration.
-
Strong understanding of distributed processing and Spark optimization.
-
Experience implementing metadata-driven and configuration-driven processing frameworks.
-
Expertise in dimensional modelling, data warehousing, and analytical data products.
-
Experience with CI/CD, Git branching, release management, and Infrastructure as Code.
-
Strong knowledge of cloud security, network controls, data governance, and access management.
-
Proven experience owning production implementations and resolving complex incidents.
-
Ability to estimate work, identify delivery risks, and lead technical teams.
Preferred skills
-
Experience with Microsoft Purview, data lineage, sensitivity labels, and governance.
-
Experience with Fabric Real-Time Intelligence, Event streams, KQL, or event-driven architectures.
-
Knowledge of Azure Databricks, Synapse Analytics, Event Hubs, Functions, Logic Apps, or API Management.
-
Experience with capacity planning, workload isolation, monitoring, and cost optimization.
Relevant Microsoft Fabric, Azure Data Engineer, Power BI, or Azure Solutions Architect certification.