ROLES AND RESPONSIBILITIES
Primary Responsibilities:
- Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL
- Work with ADF, Databricks, Synapse, BigQuery, and GCS
- Design data models and warehousing solutions
- Ensure data quality, performance, and reliability
- Collaborate with analytics and data science teams
Required Skills
- Strong Python (Pandas, PySpark), Scala, and advanced SQL
- Azure: ADF, Databricks, Synapse, ADLS Gen2, Fabric
- GCP: BigQuery, Cloud Functions, GCS, Vertex AI, Datastream
Solid understanding of ETL/ELT, batch processing, and data warehousing
Must Have Skills : Pyspark, SQL, Synapse analytics, GCP
