Databricks Consultant discussion, please be prepared to clearly articulate the following areas with practical examples from your experience:
- Data Architecture & Governance
- Explain Medallion Architecture (Bronze / Silver / Gold) and how you design reusable, governed pipelines.
- How you use Unity Catalog for access control, lineage, and auditability.
- Data Quality & Validation Approach
- Walk through your end‑to‑end data quality strategy (checks, validations, reconciliation).
- Be ready to map your approach to a formal framework (e.g., DQX‑style) with examples.
- Production Readiness & Support
- Handling pipeline failures, alerts, retries, and incident resolution.
- Experience with SLA monitoring, root‑cause analysis, and post go‑live stabilization.
- Performance & Cost Optimization
- Concrete examples of before/after improvements (runtime, cost, cluster usage).
- Techniques used: partitioning, caching, job tuning, cluster sizing.
- Stakeholder Communication
- How you explain pipelines and impacts to non‑technical stakeholders.
- Your approach to documentation, flow diagrams, and working with BI/reporting teams.
Work Location: Hybrid remote in Bengaluru, Karnataka (Bengaluru, Bengaluru Urban District)
