• 6–10 years of experience in data engineering or big data development • Design and implement ETL/ELT pipelines using Databricks and Apache Spark. • Optimize data workflows for performance, scalability, and cost efficiency. • Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions. • Manage and monitor Databricks clusters, jobs, and workflows. • Integrate Databricks with Azure/AWS/GCP services (depending on organization’s cloud strategy). • Ensure data quality, governance, and security compliance across all solutions. • Troubleshoot and resolve issues related to data ingestion, transformation, and processing. • Mentor junior engineers and contribute to best practices and standards.
Data Management, EDW
