Data Engineer (ETL) | AI/ML & Azure Data Platform
Experience: 7–8 Years
Employment Type: C2C / C2H
Location: Hybrid (Pan India)
Shift: 11:00 AM – 9:00 PM IST
Job Summary
We are seeking an experienced Data Engineer with expertise in ETL/ELT development, Azure Data Platform, Python, Apache Spark, and AI/ML. The ideal candidate will build scalable data pipelines, cloud-native data solutions, and integrate AI/LLM capabilities into enterprise data platforms.
Key Responsibilities
- Design and optimize ETL/ELT pipelines.
- Develop scalable data processing solutions using Python and PySpark.
- Build data lakes and warehouses using Azure Databricks and Snowflake.
- Develop Azure Functions and integrate Azure Service Bus.
- Automate infrastructure using Terraform and CI/CD pipelines.
- Collaborate with AI/ML teams to integrate LLMs into data workflows.
- Ensure data quality, scalability, and production support.
Required Skills
- Data Engineering & ETL/ELT
- Python
- Apache Spark (PySpark & Spark SQL)
- Azure Databricks (Unity Catalog)
- Snowflake
- Azure Functions & Azure Service Bus
- SQL
- Terraform
- Git, GitHub Actions, Artifactory & SonarQube
- AI/ML & LLM Integration (Mandatory)
Preferred Skills
Azure Data Factory, Azure Synapse, Delta Lake, MLflow, Azure DevOps, Kafka, Docker, Kubernetes, Microsoft Fabric.
Qualifications
- Bachelor's or Master's degree in Computer Science, IT, Engineering, or a related field.
- 7–8 years of Data Engineering experience with Azure cloud services.
- Strong analytical, problem-solving, and communication skills.
Pay: ₹90,000.00 - ₹100,000.00 per month
Experience:
- Azure: 7 years (Required)
- Snowflake: 4 years (Required)
- ETL: 5 years (Required)
- AI/ML Integration: 3 years (Required)
- Python: 3 years (Required)
Work Location: Hybrid remote in Pune, Maharashtra (Pune District)
