Job Description – Data Engineer (Enterprise Data Strategy)
Experience: 6+ Years
Location: Pune / Chennai / Bangalore
Payroll: Haparz
Budget: Up to 22 LPA
About the Role
We are looking for an experienced Data Engineer to join the Enterprise Data Strategy team. In this role, you will help build and enhance large-scale enterprise data pipelines that consolidate data from multiple sources into curated Databricks Unity Catalog tables. You will contribute to improving data quality, entity resolution, automated remediation, and AI-assisted data engineering capabilities supporting enterprise-wide initiatives.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines using PySpark and Databricks.
- Build and maintain Delta Lake and Unity Catalog-based data platforms.
- Develop robust data ingestion, transformation, and remediation workflows for enterprise data.
- Enhance entity resolution and data matching processes across multiple enterprise data sources.
- Integrate external APIs, including D&B DataBlocks and other third-party data providers.
- Support automated data remediation and improve data quality across enterprise datasets.
- Collaborate with data architects, analytics teams, and business stakeholders to deliver reliable data solutions.
- Participate in the redesign and modernization of enterprise data platforms.
- Contribute to AI-enabled and LLM-assisted data engineering initiatives where applicable.
- Ensure data governance, performance optimization, scalability, and operational excellence.
Required Skills
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with PySpark.
- Strong experience with Databricks.
- Expertise in Unity Catalog and Delta Lake.
- Strong programming skills in Python.
- Experience building enterprise-scale ETL and data pipelines.
- Experience with data remediation, data quality, and entity resolution/matching.
- Experience integrating external APIs.
- Good understanding of modern cloud-based data engineering practices.
Preferred Skills
- Experience with D&B DataBlocks integration.
- Exposure to LLM-assisted data workflows.
- AI-enabled data engineering experience.
- Databricks or Cloud certifications.
- Experience working with enterprise master data platforms.
Work Location: Hybrid remote in Bangalore City, Bengaluru, Karnataka
