Databricks & PySpark - Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- APIs
3d
Databricks - Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- APIs
3d
Oracle Product Data Hub - Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Oracle
- Computer Science
- Engineering
3d
Oracle Product Data Hub - Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Oracle
- Computer Science
- Engineering
3d
Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- DevOps
- SQL
7d
Databricks + PySpark - Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- APIs
Data Engg with Databricks - Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- APIs
Sr Technical Lead-App Engg Services
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- Oracle
- Computer Science
3d
Solution Architect (Vmware, Platform Engg, Network Security)
Mastercard —Pune, Maharashtra
- Full-time
- Agile
Senior Data Scientist
vConstruct —Pune, Maharashtra
- Full-time
- Azure
- Computer Science
- Master's degree
Principal Embedded Software Engg
Ethernovia, Inc. —Pune, Maharashtra
- Computer Science
- Master's degree
- C++
- Flexible schedule
Manager/Sr. Manager – CFS Service Sales
Sourceo —Pune, Maharashtra
- Full-time
- Bachelor's degree
- Communication skills
- Negotiation
4d
Manufacturing Engineer - Senior
Cummins Inc. —Pune, Maharashtra
- Assembly
- Project management
- Bachelor's degree
Purchase Engineer
Sourceo —Pune, Maharashtra
- Full-time
- AutoCAD
- ERP systems
- Microsoft Office
4d
Senior Java Developer VP
Citi —Pune, Maharashtra
- Full-time
- Oracle
- English
- Java
Manager - L&M Sales
Johnson Controls —Pune, Maharashtra
- Full-time
- Bachelor's degree
- Communication skills
- Negotiation

I want to receive the latest job alerts for technical lead data engg in pune maharashtra

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

technical lead data engg jobs near pune maharashtra

Principal Software Engineer jobs in Pune, Maharashtra

Solution Architect jobs in Pune, Maharashtra

Technical Lead jobs in Hinjawadi, Pune, Maharashtra

Sales jobs in Pune, Maharashtra

Manufacturing Engineer jobs in Pune, Maharashtra

Senior Java Developer jobs in Pune, Maharashtra

Principal Software Engineer jobs in Noida, Uttar Pradesh

Software Engineers jobs in Koratti, Thrissur, Kerala

Principal Software Engineer jobs in Punjab

Principal In Engineering Colleges jobs in Tamil Nadu

Principal Software Engineer jobs in Tamil Nadu

Principal Software Engineer jobs in Chennai, Tamil Nadu

College Principal jobs in Chennai, Tamil Nadu

Solution Architect jobs in Koregaon Park, Pune, Maharashtra

Architect jobs in Kochi, Kerala

Architect Designer jobs in Bengaluru, Karnataka

Solution Architect jobs in Chennai, Tamil Nadu

Solution Architect jobs in Kolkata, West Bengal

Solution Architect jobs in Kochi, Kerala

Interior Designer, Fresher, Architect jobs in Aurangabad, Maharashtra

Databricks & PySpark - Sr Technical Lead-Data Engg

BirlaSoft -
Hinjawadi, Pune, Maharashtra

Apply Now

Job details

3 days ago

Qualifications

CI/CD
Azure
Spark
SQL
RBAC
Continuous integration
Unity
APIs

Full job description

Country/Region: IN

Requisition ID: 38968

Work Model:

Position Type:

Salary Range:

Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI

Title: Databricks & PySpark - Sr Technical Lead-Data Engg

Description:

Area(s) of responsibility

Role Summary

We are looking for a highly skilled Databricks Data Engineer with strong hands on expertise in Databricks, PySpark, ADF, and SQL. The candidate will be responsible for architecting, developing, and optimizing modern data platforms and analytical solutions on Azure. The role requires strong experience building enterprise-grade data pipelines, enabling ingestion from diverse sources, implementing complex transformations, and supporting scalable analytics initiatives.

Key Responsibilities

1. Data Engineering Execution

Build and maintain ingestion frameworks (ADF / Databricks / Spark)
Implement Bronze -> Silver transformations aligned to architecture
Architect data quality checks, schema validation, and contract rules
Build and optimize robust, high-throughput ELT/ETL pipelines, enabling ingestion, transformation, and curation of structured, semi structured, and unstructured data.
Integrate data from multiple on premise and cloud based systems, APIs, and third-party sources.
Implement complex transformations using PySpark, ensuring performance efficiency and code modularity.
Build orchestration workflows in ADF, including pipelines, triggers, linked services, integration runtimes, and parameterized datasets.
Familiar with using Databricks Genie.
Build: Dimensional models (star/snowflake schemas), Fact tables, dimensions, surrogate keys, SCD handling
Translate Silver datasets into: Analytics-ready models, Consistent KPI definitions and business logic
Ensure: Consistency across domains (common dimensions, conformed models), Reusability and scalability of models

2. Databricks & PySpark Engineering

Develop scalable transformation scripts using PySpark on Databricks, applying advanced optimizations like caching, partitioning, and Delta Lake capabilities.
Implement Delta Lake features—ACID transactions, schema enforcement, schema evolution, and time travel—across the data lifecycle.
Perform performance tuning, handling bottlenecks related to cluster configuration, shuffle operations, joins, and parallelization.
Collaborate with platform teams to manage Databricks clusters, jobs, notebooks, and CI/CD integrations.

3. Data Governance & Quality

Implement data quality checks, audit mechanisms, and validation frameworks to ensure data accuracy and consistency in Unity Catalog.
Enforce: Unity Catalog standards; naming conventions, metadata policies; access controls (RBAC/ABAC).
Handle changes such as Column derivation logic changes (not just schema changes), Backward compatibility and impact analysis.
Partner with business / data stewards to define business rules and validate metrics and edge cases.

4. Collaboration & Stakeholder Management

Collaborate closely with customer IT and business teams to understand data requirements and deliver reliable, production-ready solutions.
Work with architects, product owners, and cross-functional engineering teams to align technical delivery with business objectives.

Provide guidance and mentoring to junior engineers when required

Apply Now

Refine Your Search

technical lead data engg jobs in pune maharashtra

Databricks & PySpark - Sr Technical Lead-Data Engg

Databricks - Sr Technical Lead-Data Engg

Oracle Product Data Hub - Sr Technical Lead-Data Engg

Oracle Product Data Hub - Technical Lead-Data Engg

Technical Lead-Data Engg

Databricks + PySpark - Technical Lead-Data Engg

Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg

Data Engg with Databricks - Technical Lead-Data Engg

Sr Technical Lead-App Engg Services

Solution Architect (Vmware, Platform Engg, Network Security)

Senior Data Scientist

Principal Embedded Software Engg

Manager/Sr. Manager – CFS Service Sales

Manufacturing Engineer - Senior

Purchase Engineer

Senior Java Developer VP

Manager - L&M Sales