Must Have (Strong hands on leadership)
• Databricks & Apache Spark – delivery leadership, troubleshooting, performance tuning
• Azure – operating within Azure based data ecosystems, identity and access concepts
• Delta Lake / Lakehouse patterns – scalable data modeling and pipeline design
• CI/CD for data pipelines – automated build, test, deploy, and release practices
• SQL & Python – strong proficiency
Good to Have
• SODA or equivalent data quality / observability tools
• Atlan or similar data catalog and metadata platforms
• Power BI awareness – understanding downstream reporting and consumption requirements
Qualifications
• Typically 7–10 years of experience in data engineering, including team or delivery leadership roles.
• Experience building and operating enterprise scale data pipelines in complex environments.
• Strong stakeholder management skills across product, engineering, analytics, and governance teams.
• Ability to balance speed, quality, and stability in delivery decisions