Role : Azure Data Engineer
Experience : 5+ Years
Location: Remote(Candidate should be open to work from Pune office initially for 2 weeks, if required)
Key Responsibilities
Design, develop, and maintain scalable data pipelines for ingestion, transformation, and validation of large datasets
Work with Apache Spark and big data ecosystem to process structured and unstructured data
Build and optimize ETL/ELT workflows for performance and reliability
Implement data quality checks, validations, and automation processes
Develop and manage data solutions using Azure Data Factory, Azure Synapse, and ADLS
Apply data warehousing concepts (star schema, snowflake schema, dimensional modeling)
Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders
Ensure data security, governance, and compliance best practices
Required Skills (Primary)
Strong proficiency in Python and SQL
Hands-on experience with Apache Spark and big data frameworks
Experience building data pipelines, transformations, validations, and automation
Solid understanding of Data Warehousing concepts
Experience with:
o Azure Data Factory
o Azure Synapse Analytics
o Azure Data Lake Storage (ADLS)
Secondary / Good-to-Have Skills
Experience with Azure DevOps
Strong knowledge of Git version control
Hands-on experience with CI/CD pipelines
Familiarity with agile development methodologies
Experience & Qualifications
Pay: ₹509,356.57 - ₹1,166,829.63 per year
Application Question(s):
- How many years of experience do you have with Azure Databricks / PySpark?
- Experience with Azure Data Lake Storage (ADLS)?
- Do you have Experience in GCP?
Experience:
- Azure: 5 years (Required)
- Data engineer: 5 years (Required)
Work Location: Remote
