Job Description: Data Engineer – Snowflake and DBT
Position Overview: We are looking for a skilled Data Engineer with a robust foundation in building and maintaining scalable ETL pipelines, data marts, and warehouses. The ideal candidate should demonstrate proficiency in programming languages such as Python and SQL and have hands-on experience with Airflow, DBT, Snowflake, and SQL. Experience in workflow orchestration, data modeling, and optimization of SQL queries is essential. The candidate should also have basic knowledge of data visualization tools like Tableau or PowerBI.
Responsibilities:
● Design, develop, and optimize ETL pipelines to ensure efficient data extraction, transformation, and loading from diverse sources.
● Automate and schedule data workflows using Apache Airflow to streamline data processing and ensure timely data availability.
● Develop robust data models and implement structured tables and views in Snowflake using DBT (Data Build Tool) for efficient data consumption by BI tools.
● Monitor pipeline performance consistently, troubleshooting and promptly resolving issues to maintain operational efficiency and minimal downtime.
● Optimize SQL queries for enhanced performance, facilitating faster data processing and reduced computational costs.
● Implement robust data quality checks to ensure accuracy, integrity, and reliability of data.
● Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable solutions.
● Optimize data pipelines for performance, scalability, and reliability to handle complex, high-volume, multi-dimensional datasets.
● Conduct thorough testing and debugging of data pipelines to ensure accuracy, completeness, and data quality.
Qualifications:
● Bachelor’s degree in Computer Science, Engineering, or a related field.
● 2-3 years of relevant experience in data engineering, particularly with ETL processes and pipeline management.
● Proficient in Python and SQL for data manipulation and transformation.
● Experience working with Apache Airflow for workflow orchestration.
● Strong knowledge of DBT for data modeling and Snowflake for data warehousing.
● Familiarity with SQL databases.
● Hands-on experience with version control systems such as Git.
● Strong analytical and problem-solving skills with meticulous attention to detail.
● Strong problem-solving skills and attention to detail in handling complex, high-volume, multi-dimensional datasets.
● Good communication skills and ability to collaborate effectively with cross-functional teams.
● Good to have experience with data visualization tools like Tableau or PowerBI.
Pay: Up to ₹1,000,000.00 per year
Benefits:
- Health insurance
- Leave encashment
- Paid time off
- Provident Fund
Ability to commute/relocate:
- Mohali, Punjab: Reliably commute or planning to relocate before starting work (Required)
Experience:
- Data Engineer: 2 years (Required)
- Snowflake: 2 years (Required)
- DBT: 2 years (Required)
- Python: 2 years (Required)
- SQL: 2 years (Required)
Location:
- Mohali, Punjab (Required)
Work Location: In person
