OLE OVERVIEW :
We are looking for a Data Platform Lead to own the design, build, and governance of our enterprise data platform. This is a role within the Data COE, responsible for driving platform maturity across a federated, multi-cloud environment. You will set engineering standards, eliminate data duplication and drift across domains, and enable reliable, governed data access - without creating centralisation bottlenecks.
KEY RESPONSIBILITIES :
- Design and evolve the enterprise data platform spanning Snowflake and Databricks across Azure and AWS
- Build and maintain production-grade ELT/ETL pipelines using Spark, dbt, Airflow, and Kafka
- Define and enforce platform standards for ingestion, transformation, storage, and access across federated domain teams
- Drive data quality, data contract adoption, and lineage visibility across the estate
- Own cloud storage architecture across S3 and ADLS; lead CI/CD practices for all platform assets
- Lead containerized workload deployment using Kubernetes for data platform services
- Coordinate with domain teams to align on standards; represent platform engineering in architecture forums
- Mentor mid-level engineers and conduct technical design reviews for platform-impacting changes
MUST-HAVE SKILLS :
- Snowflake - expert-level : data modelling, performance tuning, role-based access, zero-copy sharing, dynamic data masking
- Databricks - production experience : Delta Lake, Unity Catalog, cluster management, Databricks Workflows
- Python and SQL - strong proficiency; Scala advantageous
- Apache Spark - distributed data processing at scale
- Apache Kafka - real-time event streaming, pipeline design, topic management
- Apache Airflow - pipeline orchestration, DAG design, dependency management
- DBT - transformation layer modelling, testing, documentation
- Cloud storage - S3 and ADLS; familiarity with Parquet, Delta, and partitioning strategies
- Kubernetes - container orchestration for data platform services
- CI/CD - GitHub Actions or equivalent for data platform assets (pipelines, schemas, infra)
Pay: ₹1,500,000.00 per year
Work Location: In person
