Greetings from Doodleblue Innovations!
We are hiring for a Data Engineering Lead | Freelance Opportunity
Work Mode: Remote
Experience: 12+ years
We are looking for an experienced Data Engineering Lead to join an exciting remote freelance engagement. This is a hands-on technical leadership role, ideal for professionals who can architect scalable Databricks solutions while leading high-performing engineering teams.
Role Overview:
As a Data Engineering Lead, you'll lead the Databricks engineering team, driving solution architecture, engineering excellence, delivery quality, and stakeholder engagement. You'll design enterprise-scale Azure Databricks Lakehouse solutions, establish engineering best practices, mentor engineers, and ensure successful delivery of large-scale data platforms. This is a coding lead role, requiring strong hands-on expertise in Databricks and PySpark—not just people management.
Primary Skills:
- 12+ years of Data Engineering experience with 5+ years leading Spark/Data Engineering teams
- Strong hands-on expertise in Databricks & PySpark
- Advanced SQL
- Medallion/Lakehouse Architecture
- Data Vault 2.0
- Delta Lake & Unity Catalog
- Azure Data Services (ADLS Gen2, Azure Data Factory, Key Vault)
- Metadata-driven ingestion and transformation frameworks
- Advanced Spark performance tuning & platform cost optimisation
- Git, CI/CD, Azure DevOps/GitHub Actions & Release Management
- Experience leading distributed Onshore-Offshore delivery teams
Mandatory Domain Experience:
Strong experience in Insurance or Financial Services, preferably Property & Casualty (P&C), with hands-on knowledge of Policy, Claims, Premium, Reinsurance, and Actuarial data flows.
Good to have:
- Delta Live Tables (DLT)
- Databricks Asset Bundles
- Terraform (Azure/Databricks)
- Auto Loader & Structured Streaming
- Kafka/Event Hubs
- Migration from Legacy ETL (Informatica, DataStage, SSIS) to Databricks
- Databricks Professional Certification
- Azure Certifications (AZ-305 / DP-203 / DP-700)
Interested candidates can share their resumes to [email protected]
Job Types: Full-time, Permanent
Pay: Up to ₹250,000.00 per month
Application Question(s):
- Are you interested in a freelance opportunity?
- This is a coding lead, not a pure people-manager role. Do you have experience in Coding (Databricks + PySpark)?
- Do you have 12+ years of experience in Data Engineering?
Experience:
- Data Engineering lead: 5 years (Required)
- Coding (Databricks + Pyspark): 5 years (Required)
Work Location: Remote
