Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- APIs
Data Engg + Databricks & PySpark-Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- APIs
Azure Databricks + PySpark -Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- APIs
Azure Databricks+ PySpark- Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
Azure Databricks Sr.Architect
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- Linux
- Python
Azure Databricks Sr. Architect
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- Linux
- Python
Databricks - Lead Architect
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- AWS
- Machine learning
Sr. Lead Data Architect
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- SQL
- AWS
Sr Lead Architect
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- Computer Science
- Engineering

Related jobs to explore

Based on your search for databricks + pyspark sr technical

Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg
BirlaSoft —Hinjawadi, Pune, Maharashtra
Collaborate with BI, analytics, business teams, and architects to convert business requirements into scalable technical solutions.
Sr.Pyspark Engineer
Bitwise —Pune, Maharashtra
Over 25+ years of consistently bringing high-performance solutions to our market leading clients in diverse industries across the world, guarantees that our…
3d

I want to receive the latest job alerts for databricks + pyspark sr technical in chakan pune maharashtra

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

databricks + pyspark sr technical jobs near chakan pune maharashtra

Senior Lecturer,dental College, Mds jobs in Chennai, Tamil Nadu

Technical jobs in Haldwani, Uttarakhand

Senior Manager jobs in Chennai, Tamil Nadu

Senior Technical Lead jobs in Bhubaneswar, Orissa

Senior Technical Lead jobs in Bengaluru, Karnataka

Senior Technical Lead jobs in Pune, Maharashtra

Senior Technical Lead jobs in Jaipur, Rajasthan

Senior Technical Lead jobs in Delhi, Delhi

Senior Technical Lead jobs in Calicut, Kerala

Senior Resident, General Surgery jobs in Delhi

Lead Generation jobs in Pune, Maharashtra

Work From Home Non Technical jobs in Pune, Maharashtra

Senior Technical Lead jobs in Ahmedabad, Gujarat

Senior Architect jobs in Santacruz, Mumbai, Maharashtra

Senior Technical Writer jobs in Bengaluru, Karnataka

Architect Work From Home jobs in Bengaluru, Karnataka

Senior Architect jobs in Cbd Belapur, Navi Mumbai, Maharashtra

Senior Hr Manager jobs in Coimbatore, Tamil Nadu

Senior Architect jobs in Coimbatore, Tamil Nadu

Senior Architect jobs in R. T. Nagar, Bengaluru, Karnataka

Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg

BirlaSoft -
Hinjawadi, Pune, Maharashtra

Apply Now

Job details

Qualifications

CI/CD
Azure
Encryption
SQL
Continuous integration
APIs
Agile
Leadership

Full job description

Country/Region: IN

Requisition ID: 36161

Work Model:

Position Type:

Salary Range:

Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI

Title: Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg

Description:

Area(s) of responsibility

Role Summary
We are seeking a seasoned Senior Azure Data Engineer / Sr. Technical Lead with extensive expertise in Azure Databricks, PySpark, ADF, SQL, and modern data engineering practices. This role requires strong technical leadership, hands on engineering capabilities, and the ability to design, architect, and deliver enterprise-scale data solutions. The ideal candidate will lead complex data initiatives, mentor engineering teams, and collaborate with cross-functional stakeholders to build a robust and scalable data ecosystem on Azure.

Key Responsibilities
1. Solution Architecture & Technical Leadership
Lead the design, development, and deployment of large-scale data engineering solutions using Azure Databricks, PySpark, SQL, ADF, and Azure Data Lake.
Architect end-to-end Modern Data Warehouse (MDW) and Lakehouse solutions, ensuring scalability, performance, security, and cost optimization.
Define technical standards, coding best practices, reusable frameworks, and architectural guidelines for engineering teams.
Provide technical leadership across the project lifecycle—requirements analysis, solution blueprinting, estimation, development, and deployment.
2. Data Pipeline Engineering
Build, optimize, and maintain scalable, high performance ELT/ETL pipelines to process large volumes of structured and unstructured data.
Set up complex data ingestion frameworks, enabling seamless integration with on-premise systems, cloud services, APIs, and third-party sources.
Ensure high availability, data reliability, and error-resilient orchestration workflows in Azure Data Factory.
3. Azure Databricks & PySpark Expertise
Design and implement advanced transformation logic using PySpark on Databricks, ensuring efficient data processing and code modularity.
Utilize Delta Lake capabilities—ACID transactions, schema evolution, versioning, time travel—to manage enterprise-grade datasets.
Perform cluster-level tuning, optimization of shuffle operations, caching, partitioning, and job parallelization.
Manage Databricks job pipelines, notebooks, clusters, job scheduling, and integration with CI/CD pipelines.
4. Data Governance, Quality & Documentation
Implement data quality frameworks covering validation, reconciliation, error handling, and metadata management.
Enforce best practices for security, access control, encryption, data lineage, and auditability.
Prepare and maintain detailed documentation: technical specification documents, interface designs, architecture diagrams, and operational runbooks.
5. Stakeholder Collaboration & Team Leadership
Collaborate with BI, analytics, business teams, and architects to convert business requirements into scalable technical solutions.
Lead code reviews, provide mentoring and technical guidance to junior and mid-level engineers.
Work closely with Scrum Masters and Product Owners within an Agile delivery model.

Apply Now

Refine Your Search

databricks + pyspark sr technical jobs in chakan pune maharashtra

Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg

Data Engg + Databricks & PySpark-Sr Technical Lead-Data Engg

Azure Databricks + PySpark -Sr Technical Lead-Data Engg

Azure Databricks+ PySpark- Sr Technical Lead-Data Engg

Azure Databricks Sr.Architect

Azure Databricks Sr. Architect

Databricks - Lead Architect

Sr. Lead Data Architect

Sr Lead Architect

Related jobs to explore

I want to receive the latest job alerts for databricks + pyspark sr technical in chakan pune maharashtra

Explore jobs in more locations

Title: Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg

Area(s) of responsibility

Jobseeker tools

Employer Tools

Browse

Stay Connected