Greetings from Doodleblue Innovations!
We are hiring for a Lead Data Engineer – PySpark & Databricks | Freelance Opportunity
Work Mode: Remote
Experience: 8-10 Years
We're looking for an experienced Lead Data Engineer with strong hands-on expertise in PySpark on the Databricks platform to join our growing team.
If you're passionate about building scalable data pipelines, optimizing Spark workloads, and leading high-performing engineering teams, we'd love to connect!
Key Skills:
- Strong hands-on experience with PySpark on Databricks (must-have)
- Python and SQL programming expertise
- Expertise in building ETL/ELT pipelines and Lakehouse architecture (Bronze/Silver/Gold)
- Experience with Delta Lake, Spark SQL, and Spark performance tuning
- Azure Data Platform (ADLS Gen2, Data Factory, Synapse) preferred
- CI/CD using Azure DevOps/GitHub, Databricks Workflows, Airflow
- Experience leading or mentoring Data Engineering teams
Preferred:
- Databricks or Azure Certifications
- Unity Catalog, Delta Live Tables, MLflow
- Insurance or Financial Services domain experience
Interested candidates can share their resumes to [email protected]
Job Types: Full-time, Permanent
Pay: Up to ₹160,000.00 per month
Application Question(s):
- How many years of experience as a Lead Data Engineer - PySpark & Databricks?
- How many years of experience in PySpark & Databricks?
- Are you interested in a freelance opportunity?
Experience:
- Pyspark & Databricks: 4 years (Required)
- Data Engineering Lead: 8 years (Required)
Work Location: Remote