Key Responsibilities
Data Engineering Development
- Build and maintain data ingestion pipelines using Data Factory, Dataflows Gen2, Pipelines, and event driven patterns.
- Develop Lakehouse structures using Delta Lake, Notebooks (PySpark), and medallion architecture.
- Implement Fabric Data Warehouse objects (tables, stored procedures, views, SQL endpoints).
- Create and optimize semantic models for Power BI, including Direct Lake datasets.
- Develop KQL databases and real time analytics components where required.
Operational Delivery
- Implement CI/CD pipelines for Fabric using Git integration and DevOps best practices.
- Monitor, troubleshoot, and optimize Fabric workloads for performance and cost.
- Ensure data quality through validation rules, profiling, and automated checks.
- Support production deployments, incident resolution, and environment management.
Collaboration Stakeholder Support
- Work with Hiscox business teams to understand data requirements and translate them into technical solutions.
- Collaborate with Solution Architects to ensure alignment with overall platform design.
- Provide technical guidance to analysts, report developers, and data consumers.
Governance, Security Compliance
- Apply data governance standards using Purview integration, lineage, and metadata management.
- Implement access controls, workspace security, and data protection policies.
- Ensure compliance with insurance regulatory requirements (e.g., GDPR, Solvency II, IFRS 17).
Continuous Improvement
- Contribute to reusable frameworks, templates, and accelerators for Fabric engineering.
- Stay updated with new Fabric features and recommend adoption where beneficial.
- Participate in code reviews, design sessions, and engineering best practice forums.
________________________________________
Required Skills Experience
Technical Expertise
- 4–8 years of experience in data engineering, with strong Azure analytics background.
- Hands on experience with Microsoft Fabric, including:
o Data Engineering (Lakehouse, Notebooks, Pipelines)
o Data Factory (Dataflows Gen2, Pipelines)
o Data Warehouse (SQL Endpoint, Direct Lake)
o Power BI (datasets, DAX, semantic models)
o OneLake Delta Lake
- Strong skills in SQL, PySpark, Python, and ETL/ELT development.
- Experience with Azure services such as ADLS, ADF, Databricks, Synapse, Event Hub, and Key Vault.
Domain Knowledge
- Experience working with insurance data (policies, claims, pricing, exposure, risk) is highly desirable.
- Understanding of regulatory reporting (Solvency II, IFRS 17) is a plus.
Soft Skills
- Strong problem solving and analytical skills.
- Ability to work in agile, cross functional teams.
- Clear communication and documentation abilities.
________________________________________
Nice-to-Have
- Microsoft Fabric or Azure Data Engineer certifications.
- Experience migrating from Synapse/Databricks to Fabric.
- Familiarity with Lloyd’s market data structures.
________________________________________
Engagement Details
- Location: Hybrid/Remote with occasional visits to NTT offices (Delhi/NCH).
- Reporting: Works under the MS Fabric Solution Architect and collaborates with Hiscox Data Platform teams.
- Duration: Multi phase program aligned with Hiscox’s data modernization roadmap.
