Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Data Governance
Good to have skills : NA
Minimum
7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are seeking a highly experienced Data Engineering Team Lead / Assistant Manager with strong expertise in ETL, Big Data platforms.The ideal candidate will lead the design, development, and operational support of enterprise-scale data pipelines while also enabling metadata management and data lineage capabilities using Informatica EDC and AXON.
Roles & Responsibilities:
1. Data Governance & Metadata Management
Implement enterprise data governance frameworks using Informatica EDC and AXON.
Configure data cataloguing, metadata harvesting, and automated lineage tracking.
Enable data discovery, data classification, and impact analysis across the data landscape.
Maintain business glossary, data policies, and governance workflows within AXON.
Support data stewardship processes and governance adoption across business units.
Integrate ETL pipelines with metadata and lineage tracking frameworks.
2. Data Quality & Compliance
Implement data validation, reconciliation, and cleansing frameworks within ETL pipelines.
Develop automated checks for:
o Null handling
o Duplicate detection
o Data format validations
Ensure data accuracy, completeness, and consistency across systems.
Enforce data governance policies and regulatory compliance requirements.
Professional & Technical Skills:
3. Production Support & Incident Management
Manage scheduling jobs
Perform root cause analysis (RCA) and implement preventive solutions.
Participate in on-call rotations and L1/L2 production support.
Ensure adherence to SLAs and operational compliance standards.
4. Stakeholder Management
Drive automation, operational efficiency, and engineering best practices.
Enforce coding standards, version control, and release management processes.
5. Must-Have Skills
Big Data & Hadoop Ecosystem
Hands-on experience with:
o Apache Hive
o Apache Spark
o Apache Impala
o Apache Sqoop
Experience working on Cloudera Data Platform
Additional Information:
- The candidate should have minimum 7.5 years of experience in Data Governance.
- This position is based at our Chennai office.
- A 15 years full time education is required.
