Senior Data Engineer:
Years of Experience: 6 - 11 years
Job Description:
We are seeking an experienced Senior Data Engineer with strong expertise in Databricks and Spark technologies to join our team. The ideal candidate must have hands-on experience in building scalable data pipelines and real-time streaming solutions.
Mandatory Skills:
- Databricks Certification (Mandatory)
- Strong experience in Spark Structured Streaming
- Hands-on experience with Delta Live Tables (DLT) on Databricks
- Expertise in designing and optimizing data pipelines
Secondary Skills (Good to Have):
- Experience with Apache Druid
- Knowledge of data warehousing and big data architecture
Responsibilities:
- Design, develop, and maintain scalable data pipelines on Databricks
- Implement real-time streaming solutions using Spark Structured Streaming
- Develop and manage Delta Live Tables workflows
- Collaborate with cross-functional teams to deliver high-quality data solutions
- Optimize performance and ensure data reliability
Benefits:
Work Location: In person
