Job Overview:
We are looking for a Tech Lead with strong expertise in PySpark, Apache Spark, and Google Cloud Dataproc to lead the development of scalable data processing solutions.
Key Responsibilities:
- Lead and develop scalable data pipelines using PySpark and Apache Spark.
- Design, optimize, and manage ETL/ELT pipelines on GCP Dataproc.
- Guide the team on Spark development, optimization, and best practices.
- Work with BigQuery, GCS, and Cloud Composer/Airflow.
- Troubleshoot technical and production issues and ensure reliable data solutions.
- Collaborate with stakeholders to understand requirements and deliver solutions.
Required Skills:
- 5–7 years of experience in Data Engineering/Big Data.
- Strong hands-on experience with PySpark, Spark, Python, and SQL.
- Strong experience with Google Cloud Dataproc/GCP.
- Good knowledge of Spark optimization and performance tuning.
- Experience in leading or mentoring technical teams.
Pay: ₹50,000.00 - ₹90,000.00 per month
Benefits:
Work Location: In person
