Data Engineer (Microsoft Fabric)
Location: Remote
Experience: 8+ Years
Employment Type: Contract (3 Months – Extendable)
Shift: 1:30 PM – 10:30 PM IST
Job Summary
We are looking for an experienced Data Engineer with strong expertise in Microsoft Fabric to design, develop, and maintain scalable data pipelines and modern data platforms. The ideal candidate should have hands-on experience with ETL/ELT processes, PySpark, SQL, data modeling, and delivering reliable, production-grade data solutions.
Key Responsibilities
- Analyze source systems and business requirements to design scalable data solutions.
- Translate business requirements into robust data models and pipeline architectures.
- Build and maintain data ingestion pipelines from multiple sources, including batch and incremental (delta) loads, into Microsoft Fabric.
- Develop scripts to ingest data from databases, APIs, and flat files.
- Ingest and manage raw data in the Bronze Layer with reliability, scalability, and traceability.
- Transform raw data into standardized Silver Layer datasets using data cleansing, deduplication, validation, and conformance techniques.
- Design and develop Gold Layer data models, including fact tables, dimension tables, and aggregated datasets for analytics and reporting.
- Develop end-to-end ETL/ELT pipelines across Bronze, Silver, and Gold layers.
- Create semantic models and reporting-ready datasets.
- Implement data quality validations, including completeness, accuracy, freshness, and reconciliation checks.
- Build robust error-handling mechanisms with logging, retry logic, exception handling, and alerting.
- Design self-healing pipelines using checkpointing, idempotent processing, auto-retry, and recovery strategies.
- Optimize pipeline performance and ensure reliable production-grade data processing.
- Monitor and troubleshoot pipeline failures and performance bottlenecks.
- Implement CI/CD and DevOps best practices for deployments across Development, Test, and Production environments.
- Develop, modify, and debug data processing scripts using PySpark and SQL.
- Follow software engineering standards, coding best practices, and documentation guidelines.
- Collaborate with Business, BI, and Architecture teams to deliver scalable end-to-end data solutions.
Required Skills
- 8+ years of experience as a Data Engineer.
- Strong hands-on experience with Microsoft Fabric.
- Expertise in PySpark, SQL, and ETL/ELT development.
- Experience designing and implementing Bronze, Silver, and Gold data lakehouse architectures.
- Strong knowledge of data modeling, data warehousing, and analytics solutions.
- Experience building data ingestion pipelines from databases, APIs, and flat files.
- Hands-on experience with incremental and delta data loading techniques.
- Knowledge of data quality validation, monitoring, logging, and error handling.
- Experience implementing CI/CD and DevOps practices for data engineering solutions.
- Strong analytical, problem-solving, and debugging skills.
- Excellent communication and stakeholder management skills.
Preferred Qualifications
- Experience delivering enterprise-scale data engineering solutions using Microsoft Fabric.
- Knowledge of modern cloud-based data platforms and Lakehouse architecture.
- Experience working with global clients and cross-functional teams.
- Microsoft Fabric or Azure Data Engineering certifications are an added advantage.
Job Details
- Role: Data Engineer (Microsoft Fabric)
- Industry: Information Technology / Consulting
- Work Mode: Remote
- Shift: 1:30 PM – 10:30 PM IST
- Contract Duration: 3 Months (Extendable)
- Notice Period: Immediate to 15 Days Preferred
Apply Now
If you have strong experience in Microsoft Fabric, PySpark, SQL, ETL/ELT, and modern data engineering, we'd love to hear from you.
Please share your updated resume along with your current CTC, expected CTC, notice period, and current location while applying.
Interested candidates can share their updated resume to:
[email protected]
Pay: ₹70,000.00 - ₹90,000.00 per month
Work Location: Remote
