Software Engineer – Data

Techvariable -
Remote

Apply Now

Job details

Full-time

Qualifications

Azure
Computer Science
Spark
Master's degree
SQL
OOP
Bachelor's degree
Distributed systems
Unity
Kafka
Python
Information Technology

Full job description

Full Time

Remote

Experience -

4-7+ years

CTC-

Best In Industry

Job Description

We are seeking a highly skilled and passionate Senior Software Engineer (Data) to join our dynamic team. In this role, you will be instrumental in designing, developing, and maintaining robust and scalable data pipelines and infrastructure. If you’re a data enthusiast with a strong engineering mindset and a knack for solving complex data challenges, we encourage you to apply!

Roles and Responsibilities

Design, build, and optimize scalable data pipelines for ingestion, transformation, and loading of large datasets.
Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
Implement data quality checks and monitoring to ensure data integrity and reliability.
Develop and maintain data models, ensuring efficient storage and retrieval.
Troubleshoot and resolve issues related to data pipelines and data infrastructure.
Contribute to the continuous improvement of our data platform and best practices.

Required Skills & Qualifications

Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
4-7 years of dedicated experience in data engineering.
Strong proficiency in Python with a deep understanding of Object-Oriented Programming (OOP) concepts
Expertise in SQL for complex data querying, manipulation, and optimization.
Solid grasp of data engineering concepts, including data warehousing, ETL/ELT, data modeling, and distributed systems.
Hands-on experience with Databricks, including familiarity with Unity Catalog and key features like Delta Lake, notebooks, and job orchestration.
Proven hands-on experience with PySpark for large-scale data processing and analysis.
Basic understanding of Azure Cloud Services, particularly those relevant to data storage and processing.

Preferred Qualifications

- Experience with Spark streaming frameworks (e.g., Structured Streaming).
- Familiarity with Kafka for real-time data ingestion and processing is a plus.
- Experience with Azure Data Factory is a plus.

Apply Now

Experience -

CTC-

Job Description

Roles and Responsibilities

Required Skills & Qualifications

Jobseeker tools

Employer Tools

Browse

Stay Connected