Job Title: Data Engineer lead
Experience Required: 10+ Years
Location: Hyderabad/Ahmedabad
Employment Type: Full-time
Position Overview
We are seeking an experienced Data Engineer with over 10 years of experience in designing, developing, and optimizing enterprise-scale data solutions. The ideal candidate will lead our data engineering strategy, architect cloud-based data platforms, and mentor engineering teams to deliver scalable and reliable data systems that power business intelligence, AI, and analytics.
Roles & Responsibilities
- Design and implement modern data architectures across cloud and hybrid environments.
-
Develop and optimize data pipelines and ETL/ELT processes for high-volume, high-velocity data.
-
Lead data platform modernization initiatives using cutting-edge tools and frameworks.
-
Define and enforce data governance, security, and compliance standards.
-
Partner with Data Science, BI, and Product teams to ensure data availability, accuracy, and performance.
-
Provide technical leadership and mentorship to data engineers and developers.
-
Implement DevOps/Data Ops practices for automated testing, deployment, and monitoring.
-
Continuously evaluate and introduce innovative data technologies that enhance efficiency and scalability.
-
Translate business requirements into robust and scalable technical data solutions.
-
Support real-time and streaming data architectures for analytics and ML workloads.
-
Designing and developing REST APIs / Azure App Services and implementing Azure PaaS solutions.
Required Skills & Qualifications
-
Bachelor’s or master’s in computer science, Engineering, or related field.
-
10+ years in Data Engineering or Data Architecture roles.
-
Expertise in Python, SQL, Spark, Kafka, and Airflow.
-
Proven experience with cloud platforms (AWS, Azure, or GCP).
-
Hands-on experience with Snowflake, Databricks, or Delta Lake.
-
Strong understanding of data modelling, governance, and lineage tools.
-
Excellent problem-solving, leadership, and communication skills.
Good to Have Skills:
- C#, .NET Core, Azure PaaS, Problem-Solving, REST API Development, EF Core, Leadership, Agile Practices.
- Blazor UI, Azure IPaaS (Azure Integration Services), Design Patterns, and Cloud Security best practices.