The role demands strong engineering expertise in data integration, Medallion Architecture, PySpark, SQL development, data modeling, and CI/CD implementation.
- Build Bronze, Silver, and Gold data layers using Medallion Architecture.
- Develop ETL/ELT pipelines using Fabric Data Factory and Dataflows.
- Create scalable data ingestion frameworks across cloud and on-prem data sources.
- Develop Spark notebooks using PySpark.
- Implement Delta Lake optimization techniques and Optimize query performance and data access patterns.
- Perform data cleansing, enrichment, and quality validations.
- Build enterprise semantic models
- Support Power BI Direct Lake implementations.
- Build deployment pipelines across DEV, QA, UAT, and PROD environments.
Key Skills to be seen in Resume: OneLake, LakeHouse, Notebook, Pyspark, Python, Semantic Model, Synapse, Medallion Architecture
