Job Type: Contract (C2C)
Experience: 7–8 Years
Work Mode: Hybrid (Pan India)
Working Hours: 11:00 AM – 9:00 PM IST
Job Overview
We are seeking an experienced Data Engineer (ETL) to design, develop, and maintain scalable data pipelines and cloud-based data platforms. The ideal candidate should have strong expertise in ETL/ELT development, big data technologies, Azure cloud services, and modern data engineering practices.
Key Responsibilities
- Design, develop, and optimize ETL/ELT pipelines for enterprise data processing.
- Build scalable data processing solutions using Python, PySpark, and Spark SQL.
- Develop and maintain data solutions using Azure Databricks and Snowflake.
- Implement data integration using Azure Functions and Azure Service Bus.
- Create and optimize SQL queries, data transformations, and data models.
- Automate infrastructure deployment using Terraform and CI/CD tools.
- Collaborate with cross-functional teams to support analytics, reporting, and data platform initiatives.
- Troubleshoot, optimize, and enhance data pipeline performance and reliability.
- Support AI/ML and LLM-based data engineering initiatives where applicable.
Required Skills
- 7–8 years of experience in Data Engineering.
- Strong experience in ETL/ELT pipeline development.
- Proficiency in Python.
- Hands-on experience with Apache Spark (PySpark, Spark SQL).
- Experience with Azure Databricks (Unity Catalog preferred).
- Strong knowledge of Snowflake.
- Experience with Azure Functions and Azure Service Bus.
- Strong SQL development and query optimization skills.
- Hands-on experience with Terraform.
- Experience with Git, GitHub Actions, Artifactory, SonarQube, and CI/CD pipelines.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and collaboration skills.
Preferred Skills
- Experience with AI/ML projects.
- Exposure to Large Language Models (LLMs) and Generative AI.
- Knowledge of cloud data architecture and performance optimization.
Education
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Pay: ₹80,000.00 - ₹100,000.00 per month
Experience:
- Apache Spark: 5 years (Required)
- Azure Databricks: 4 years (Required)
- Snowflake.: 5 years (Required)
Work Location: Remote
