It engineer data lakehouse Jobs

Senior Data Engineer
Valethi Technologies LLP —Nagpur, Maharashtra
- Up to ₹33,00,000 a year
- Full-time
- DevOps
- SQL
- Agile
- Health insurance
- Flexible schedule
Quick apply
Senior Data Engineer
Bosch Group —Bengaluru, Karnataka
- ₹24,00,000 - ₹28,00,000 a year
- Full-time
- Computer Science
- Java
- Master's degree
Quick apply
14d
Senior Data Engineer
Innovecture —Remote
- Remote
- SQL
- AWS
- APIs
Quick apply
5d
Data Engineer
Stepping Stone Consultancy Services —Kochi, Kerala
- From ₹5,09,356.57 a year
- Full-time
- Azure
- Computer Science
- Master's degree
Quick apply
Senior Data Engineer
Procter & Gamble —Nanakramguda, Hyderabad, Telangana
- Full-time
- Azure
- Computer Science
- Master's degree
Data Engineer
Kyndryl —Bengaluru, Karnataka
- Full-time
- Hybrid work
- Azure
- DevOps
- Databases
Data Engineer
Prolifics —Hyderabad, Telangana
- Master's degree
- SQL
- Bachelor's degree
11d
Data Engineer
Innovecture —Pune, Maharashtra
- Azure
- Oracle
- DevOps
Quick apply
6d
Data Engineer (AWS)
CACI Ltd —Hyderabad, Telangana
- Weekend availability
- Oracle
- Databases
- SQL
- Health insurance
Quick apply
Lead IT Engineer - Data & BI
Johnson Electric Private Limited – Shared Services —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- SQL
Quick apply
Data Engineer
Aptean —Bengaluru, Karnataka
- Full-time
- Azure
- Doctoral degree
- Computer Science
7d
Data Engineer
Accenture —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- Bachelor's degree
IT engineer data lakehouse
Continental —Bengaluru, Karnataka
- Online application
- Azure
- Computer Science
- DevOps
IT engineer Data Lakehouse - Tech Lead
Continental —Bengaluru, Karnataka
- Online application
- Computer Science
- Master's degree
- Machine learning
Data Engineer (Azure & Microsoft Fabric)
GoWin Training —Bengaluru Rural District, Karnataka
- Azure
- DevOps
- SQL
Quick apply
IT engineer data lakehouse M&E/QM
Continental —Bengaluru, Karnataka
- Online application
- Azure
- Computer Science
- DevOps
Data Engineer
PayPay India —Gurugram, Haryana
- SQL
- AWS
- AI
Sr. Data Engineer
Cohere Health —Hyderabad, Telangana
- Computer Science
- Master's degree
- SQL
Quick apply
1d
Fabric Data Engineer
Quest Global —Bengaluru, Karnataka
- Full-time
- Oracle
- SQL
- Communication skills
Quick apply
AWS Architect with Databricks
Ipeople Infosysteams LLC —Remote
- ₹30,00,000 - ₹35,00,000 a year
- Full-time
- Remote
- Computer Science
- DevOps
- Master's degree
Quick apply
5d

I want to receive the latest job alerts for it engineer data lakehouse

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

it engineer data lakehouse jobs near

Senior Data Engineer

Valethi Technologies LLP -
Nagpur, Maharashtra

Quick apply

Job details

Full-time
Up to ₹33,00,000 a year

Benefits

Health insurance
Flexible schedule

Qualifications

CI/CD
Node.js
Software deployment
DevOps
Data structures
Spark
Git
SQL
Quality assurance
Terraform
Continuous integration
GitHub
Agile
Public relations
GitLab
Communication skills
Python

Full job description

Job Description: Senior Data Engineer – Data Ingestion & Platforms

Role Overview

We are seeking a seasoned Senior Data Engineer with a strong software engineering mindset to design, build, and optimize our next-generation Ingest Factory and Data Processing Frameworks. In this role, you will go beyond traditional ETL scripting to build scalable, metadata-driven pipelines and reusable data frameworks.

The ideal candidate possesses deep expertise in Python, PySpark, and the Databricks Lakehouse ecosystem (including LakeFlow and Delta Lake), combined with rigorous software engineering discipline (SOLID, CI/CD, and infrastructure as code). You will work both independently and collaboratively within an Agile environment to build production-grade software that ensures data quality, governance, and seamless orchestration.

Key Responsibilities

Architecture & Pipeline Engineering

Ingest Factory Design: Design, develop, and maintain robust data ingestion frameworks leveraging Databricks LakeFlow, managed connectors, and declarative pipelines.
Data Lakehouse Patterns: Implement repeatable ETL/ELT patterns within a Delta Lake architecture, ensuring optimized storage, table design, and strict data lineage enforcement.
Metadata-Driven Orchestration: Build parameterized notebooks and end-to-end orchestration flows to automate ingestion across diverse source system patterns.

Software Craftsmanship & Automation

Advanced Python Development: Write clean, modular, and maintainable Python code applying

SOLID and DRY principles. Move beyond basic PySpark scripting to contribute to and publish reusable internal packages (e.g., PyPI).

Framework Creation: Define reusable functions and framework-level abstractions to dramatically improve development efficiency across the data team.
Testing & Quality Assurance: Implement rigorous data quality checks, monitoring, and alerting frameworks. Lead test practices including Unit, Integration, and End-to-End (E2E) testing.

Optimization & Troubleshooting

Performance Tuning: Optimize complex distributed Spark workloads, Databricks compute configurations, and SQL queries (efficient filtering, indexing, and joins) to reduce processing costs.
Advanced Troubleshooting: Deep dive into Spark UI and logs to diagnose and resolve performance bottlenecks, data skew, and serialization issues.

DevOps & Collaboration

CI/CD & IaC: Own the deployment lifecycle by building and maintaining GitHub Actions / GitLab

pipelines and provision infrastructure utilizing Terraform (IaC).

Agile Delivery: Actively participate in SCRUM ceremonies, design solutions to specific user stories, vet architectures with the team, and deliver retro demos prior to production deployment.

Technical Skillset & Qualifications

Must-Have Core Skills:

Cloud Data Experience: 6+ years of production experience in cloud data engineering and building enterprise-grade software.
Databricks Ecosystem: Deep hands-on experience with Databricks Notebooks, Jobs optimization, Delta Lake, Connectors, and LakeFlow (jobs, tasks, flows).
Advanced Python & Spark: Mastery of Core Python, Data Structures & Algorithms (DSA), and package management. Clear understanding of distributed workloads (Spark vs. single-node processing).
Software Engineering Disciplines: 3–5+ years of practicing SOLID coding principles, Git controls

(PR reviews, branching strategies), and modern IDE features (Cursor/VSCode).

DevOps & Automation: Production experience with Terraform and CI/CD tools (GitHub Actions or GitLab CI).
Advanced SQL: Proficiency in writing and optimizing mid-to-complex queries, ensuring efficient data processing and model design.

Soft Skills & Operational Traits:

Ability to work independently as a self-starter while being a highly collaborative team player.
Strong business and data literacy—understanding not just how to move data, but the business purpose behind it.
Excellent communication skills for vetting solutions with peer engineers and presenting work during retro demos.

Pay: Up to ₹3,300,000.00 per year

Benefits:

Flexible schedule
Health insurance

Work Location: In person

Quick apply

Refine Your Search

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Data Engineer

Senior Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer (AWS)

Lead IT Engineer - Data & BI

Data Engineer

Data Engineer