A Lead Data Engineer 7+years of experience is responsible for designing, building, and overseeing an organization’s data infrastructure and engineering strategy. The role combines hands-on technical expertise with architecture, mentorship, and cross-functional leadership.
Core Responsibilities
- Design scalable data platforms and pipelines
- Lead ETL/ELT architecture and orchestration
- Own data warehousing/lakehouse strategy
- Ensure data quality, governance, and reliability
- Optimize performance and cloud costs
- Mentor data engineers and establish standards
- Collaborate with analytics, ML, and product teams
- Drive CI/CD, observability, and platform automation
Common Tech Stack
- Languages: Python, SQL, Scala, Java
- Big data: Spark, Kafka, Flink
- Cloud: AWS, Azure, GCP
- Warehouses: Snowflake, BigQuery, Redshift, Databricks
- Orchestration: Airflow, Dagster, Prefect
- Infrastructure: Terraform, Kubernetes, Docker
- Data modeling: dbt, dimensional modeling, Data Vault
Typical Skills ExpectedAreaExamplesData ArchitectureLakehouse, medallion architectureDistributed SystemsSpark tuning, partitioningStreamingKafka, event-driven pipelinesDevOps/DataOpsCI/CD, IaC, observabilityLeadershipMentoring, roadmap planningGovernanceSecurity, lineage, compliance
Pay: ₹2,500,000.00 - ₹4,000,000.00 per year
Benefits:
- Paid sick time
- Provident Fund
Work Location: In person
