Data Engineer – Databricks
Experience: 5–7 Years
Location: As per requirement
Job Description
We are looking for an experienced Data Engineer – Databricks with strong expertise in designing, developing, and maintaining scalable data pipelines and data engineering solutions using the Databricks ecosystem.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines using Databricks.
- Develop solutions using PySpark, Spark SQL, and Python.
- Work with Delta Lake for reliable and scalable data processing.
- Build and optimize data pipelines using Databricks Workflows.
- Perform data transformation, cleansing, validation, and optimization.
- Work with cloud data platforms such as Azure/AWS.
- Optimize Spark jobs, queries, and data processing performance.
- Implement data quality, monitoring, and error-handling mechanisms.
- Collaborate with Data Scientists, Analysts, and other engineering teams.
Required Skills
- 5–7 years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong PySpark / Apache Spark / Spark SQL skills.
- Excellent Python and SQL knowledge.
- Experience with Delta Lake and Databricks Workflows.
- Experience in ETL/ELT and data pipeline development.
- Good understanding of data warehousing and data lake architecture.
- Experience with Git and CI/CD.
- Cloud experience in Azure or AWS is preferred.
Pay: ₹50,000.00 - ₹90,000.00 per month
Benefits:
- Health insurance
- Provident Fund
Work Location: In person
