Good Communication & presentation skills.
- Strong Knowledge of Azure Components Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databricks
Data Pipeline Development:
Design, build, and maintain efficient, reusable, and reliable data pipelines.
Ensure data flow between different systems and databases is seamless and error-free.
ETL Processes:
Develop and maintain ETL (Extract, Transform, Load) processes to aggregate data from various sources.
Ensure data quality and integrity throughout the ETL process.
Performance Optimization:
Optimize data pipelines and queries for performance.
Identify and resolve bottlenecks in data processing workflows.
