Experience: 10+ Years
Location: Kochi / Coimbatore / Chennai / Mumbai / Pune
LinkedIn Profile: Mandatory
About the Role
We are looking for an experienced Lead Data Engineer to design, develop, and support enterprise-grade data platforms and pipelines. The ideal candidate should have strong expertise in Azure Data Engineering, Databricks/Microsoft Fabric, PySpark, SQL, data migration, and modern data architecture, along with hands-on experience in production and L2/L3 support.
Key Responsibilities
- Design and develop scalable enterprise data pipelines using Azure data technologies.
- Build and optimize data solutions using Azure Data Factory, Azure Databricks/Microsoft Fabric, PySpark, and Delta Lake.
- Implement Medallion Architecture and modern data engineering best practices.
- Lead data migration initiatives and ensure data quality, reliability, and performance.
- Develop effective data models and optimize complex SQL queries and data workloads.
- Perform performance tuning, job monitoring, troubleshooting, and failure recovery.
- Provide L2/L3 production support, including RCA, incident resolution, and job failure troubleshooting.
- Participate in on-call support and Hypercare activities during critical releases and migrations.
- Ensure data governance, security, documentation, and compliance standards.
- Mentor data engineers and provide technical guidance across projects.
Mandatory Skills
- Advanced SQL
- Azure Data Factory (ADF)
- Azure Databricks / Microsoft Fabric
- PySpark
- Delta Lake
- Medallion Architecture
- Data Migration
- Data Modeling
- Production Support / L2-L3 Support
- RCA & Job Failure Troubleshooting
- On-call Support & Hypercare
Qualification
Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
Ideal Candidate
- 10+ years of experience in Data Engineering with strong Azure expertise.
- Proven experience handling enterprise-scale data platforms and production environments.
- Strong problem-solving, troubleshooting, communication, and mentoring skills.
Pay: ₹500,000.00 - ₹1,100,000.00 per year
Benefits:
Work Location: In person
