Job Title: Data Engineer – Scala
Location: Hybrid – Pan India
Experience: 6+ Years
Work Mode: Hybrid
Shift Timing: 11:00 AM – 9:00 PM
Job Summary
We are seeking an experienced Data Engineer – Scala to join our team. The ideal candidate will have 6+ years of experience in designing, developing, and optimizing scalable data platforms and enterprise-level data pipelines. The candidate should have strong hands-on expertise in Scala, Apache Spark, Python, SQL, and cloud technologies (Azure/AWS).
You will be responsible for building robust data solutions, developing ETL/ELT pipelines, optimizing data workflows, and collaborating with engineering and analytics teams to deliver high-quality data platforms.
Key Responsibilities
- Design, develop, and maintain scalable batch and real-time data pipelines.
- Build and optimize ETL/ELT workflows using Scala, Apache Spark, and Python.
- Develop high-performance SQL queries and optimize data models.
- Work with cloud-based data services across Azure and/or AWS environments.
- Implement data ingestion, transformation, and processing solutions.
- Monitor, troubleshoot, and improve data pipeline performance and reliability.
- Ensure data quality, consistency, and governance across data platforms.
- Collaborate with cross-functional teams to deliver end-to-end data solutions.
- Participate in code reviews, technical discussions, and CI/CD implementation.
Required Skills
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with Scala and Apache Spark.
- Good programming experience in Python.
- Strong knowledge of SQL and database concepts.
- Experience designing and developing ETL/ELT pipelines.
- Hands-on experience with cloud platforms such as Azure and/or AWS.
- Experience with Azure Data Factory (ADF), AWS Glue, or similar data integration tools.
- Strong understanding of Data Warehousing and Big Data technologies.
- Experience working with Agile methodologies and CI/CD practices.
Good to Have Skills
- Experience with Azure Synapse Analytics.
- Knowledge of Apache Kafka and streaming technologies.
- Experience with Databricks, Delta Lake, and Lakehouse Architecture.
- Exposure to Data Governance and Data Quality frameworks.
- Experience working with ML/GenAI data pipelines.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Strong analytical and problem-solving skills.
- Ability to work independently and collaborate effectively with teams.
Pay: ₹100,000.00 - ₹200,000.00 per year
Work Location: Remote
