Data Engineer position requiring 3-4 years of experience with strong skills in SQL and PySpark, focusing on building and maintaining scalable data pipelines in cloud-integrated environments.
We are seeking a Data Engineer to join our team. This role involves building and maintaining data pipelines on‑premises with cloud integration. Join us to deliver high‑quality data solutions.
Key responsibilities
Design, implement, and maintain scalable data pipelines.
Optimize SQL queries for performance.
Develop PySpark jobs for data processing.
Orchestrate workflows using Airflow.
Manage data ingestion with NiFi and Cloudera.
Integrate on‑prem and cloud components.
Collaborate with cross‑functional teams.
Monitor performance and troubleshoot issues.
Required qualifications
Minimum 3-4 years of data engineering experience.
B.Tech degree in Computer Science, Engineering or related field.
Strong SQL and PySpark skills.
Hands‑on experience with Airflow.
Familiarity with NiFi and Cloudera.
Experience with at least one cloud platform, preference for AWS.
Nice to have
