Experience: 6+ years
Location: Remote
Budget: [Specify if needed]
We are looking for an experienced Data Engineer with expertise in Azure Data Factory (ADF), Databricks, and Data Modeling. The ideal candidate should have a strong technical background in data pipeline development, transformation, and optimization, along with excellent communication skills to collaborate with cross-functional teams.
- Design, develop, and optimize ETL pipelines using Azure Data Factory (ADF).
- Build and maintain scalable data processing solutions in Databricks.
- Implement and manage data models, ensuring efficiency and performance.
- Work with structured and unstructured data, applying best practices in data transformation and modeling.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Ensure data integrity, security, and compliance in alignment with organizational policies.
- Optimize data storage, retrieval, and performance tuning in cloud environments.
- Troubleshoot data pipeline issues and implement improvements.
- Azure Data Factory (ADF) – Strong experience in developing and managing data pipelines.
- Databricks – Hands-on expertise in building and optimizing Spark-based data transformations.
- Data Modeling – Experience in designing OLAP, OLTP, and dimensional models.
- SQL & NoSQL Databases – Proficiency in handling large datasets.
- Programming Languages – Proficiency in Python, SQL, or Scala for data processing.
- Azure Cloud – Strong understanding of Azure Synapse, Azure Storage, and other data services.
- Big Data Processing – Experience with distributed computing frameworks like Apache Spark.
- CI/CD & DevOps – Familiarity with Azure DevOps, Git, and automation tools for deploying data pipelines.
- Strong communication skills – Ability to clearly explain technical concepts to non-technical stakeholders.
- Problem-solving mindset – Analytical approach to troubleshooting and optimizing data workflows.
- Collaboration – Experience working with cross-functional teams.
- Experience with Power BI or other visualization tools.
- Knowledge of Kafka, Event Hub, or real-time data streaming technologies.
- Certifications in Azure Data Engineering (DP-203) or equivalent.
