Badkhal Lake Delhi Delhi Python senior technical lead devops Jobs – 100 Open Jobs Today

Senior Big Data Engineer (Scala | PySpark | AWS Glue | Databricks)
WebSenor —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- Master's degree
Quick apply
6d
Senior AI Architect
Impetus Technologies —Noida, Uttar Pradesh
- Azure
- Computer Science
- Salesforce
Senior Product Engineer
BetterDrones —Noida Sector 62, Noida, Uttar Pradesh
- From ₹55,000 a month
- Full-time
- Azure
- Computer Science
- Java
- Health insurance
- Paid time off
Quick apply
2h
Lead Platform Engineer
Bain & Co. —Gurugram, Haryana
- Full-time
- Computer science
- Azure
- Computer Science
Quick apply
Senior Software Engineer
R1 RCM, Inc. —Noida, Uttar Pradesh
- Full-time
- Azure
- Master's degree
- SQL
Senior Data Solution Architect
EPAM Systems, Inc. —Gurugram, Haryana
- Azure
- DevOps
- Java
- Health insurance
- Paid time off
Cloud Technology Consultant - AWS Cloud, Director
EPAM Systems, Inc. —Gurugram, Haryana
- Azure
- DevOps
- English
- Health insurance
- Paid time off
Senior AI Platform Engineer
PAR —Gurugram, Haryana
- Full-time
- Hybrid work
- Hospitality
- Management
- Computer Science
Senior Consultant | APS - BY | Noida | Supply Chain & Network Operations
Deloitte —Noida, Uttar Pradesh
- Azure
- Oracle
- DevOps
Senior Associate, FinanceTransformation Data Engineer - Global Capability Center
Alvarez & Marsal —Gurugram, Haryana
- DevOps
- SQL
- Analysis skills
Senior Software Engineer - Full stack
Barco —Noida, Uttar Pradesh
- Azure
- Computer Science
- DevOps
Senior Software Engineer
Stryker —Gurugram, Haryana
- Full-time
- Computer Science
- DevOps
- System design
- Health insurance
Senior Analyst, Quality Assurance
Connor, Clark & Lunn Financial Group Ltd. —Gurugram, Haryana
- Azure
- DevOps
- SQL
Quick apply
Track Manager - Oracle Administration,PostgreSQL
HCLTech —Noida, Uttar Pradesh
- Rotational shift
- Azure
- Oracle
- Computer Science
13d
Senior AI Engineer / Senior Machine Learning Specialist
IMPRONICS DIGITECH PRIVATE LIMITED —Gurugram, Haryana
- Azure
- Computer Science
- Java
Quick apply
Senior Software Engineer
Insight Enterprises —Gurugram, Haryana
- Computer Science
- DevOps
- Java
- Health insurance
23h
Senior Associate, Business Intelligence Unit, GESS - Global Capability Center
Alvarez & Marsal —Gurugram, Haryana
- DevOps
- Databases
- SQL
9d
SDE 1 (Backend developer)
TravClan Technology India —Connaught Place, Delhi, Delhi
- ₹7,00,000 - ₹14,00,000 a year
- Full-time
- System design
- Java
- Databases
Senior Associate Full stack + AI (Consumer Products AI)
Bain & Co. —Gurugram, Haryana
- Full-time
- Azure
- Computer Science
- DevOps
Quick apply
5h
Senior Cyber Security Specialist
Fonada —Noida, Uttar Pradesh
- ₹15,00,000 - ₹20,00,000 a year
- Full-time
- Azure
- Computer Science
- AWS
- Health insurance
Quick apply

I want to receive the latest job alerts for python senior technical lead devops in badkhal lake delhi delhi

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

python senior technical lead devops jobs near badkhal lake delhi delhi

Senior Software Engineer jobs in Noida, Uttar Pradesh

Full Stack Developer jobs in Noida, Uttar Pradesh

Big Data Architect jobs in Noida, Uttar Pradesh

Full Stack Developer jobs in Gurugram, Haryana

Senior Software Engineer jobs in Safdarjung Enclave, Delhi, Delhi

Senior Software Engineer jobs in Ahmedabad, Gujarat

Senior Software Engineer jobs in Gandhinagar, Gujarat

Systems Engineer jobs in Coimbatore, Tamil Nadu

Senior Software Engineer jobs in Panaji, GOA

Senior Accountant jobs in Cbd Belapur, Navi Mumbai, Maharashtra

Quality Engineer jobs in Nagpur, Maharashtra

2 Year Experience Software Engineer jobs in Pune, Maharashtra

Senior Business Intelligence Analyst jobs in Chennai, Tamil Nadu

Business Development Executive jobs in Indore, Madhya Pradesh

Senior Citizens, Work From Home jobs in Kolkata, West Bengal

Financial Analyst jobs in Mumbai, Maharashtra

Senior Business Intelligence Analyst jobs in Mumbai Central, Mumbai, Maharashtra

Senior Business Intelligence Analyst jobs in Mumbai, Maharashtra

Senior Business Intelligence Analyst jobs in Visakhapatnam, Andhra Pradesh

Walkin Interview, Data Analyst jobs in Navi Mumbai, Maharashtra

Senior Big Data Engineer (Scala | PySpark | AWS Glue | Databricks)

WebSenor
Noida, Uttar Pradesh

Quick apply

Job details

Full-time
6 days ago

Qualifications

CI/CD
Cloud infrastructure
Azure
Computer Science
Big data
Spark
AWS Certification
Microsoft SQL Server
Git
AWS Certified Solutions Architect – Associate
MongoDB
Master's degree
SQL
AWS
Bachelor's degree
Machine learning
PostgreSQL
Distributed systems
Scala
Continuous integration
Azure Certification
Scrum
GitHub
ETL
Agile
S3
Metadata
AI
Jenkins
Communication skills
Python
MySQL
AWS Certified Solutions Architect – Professional
Identity & access management
Hadoop
Information Technology

Full job description

We are seeking an experienced Senior Big Data Engineer with expertise in Scala, PySpark, AWS Glue, Databricks, Delta Lake, EMR, Snowflake Migration, and Big Data Pipeline Development. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, modernizing enterprise data platforms, and supporting cloud-based analytics and AI initiatives.

The candidate should have strong experience in distributed data processing, ETL/ELT development, data quality frameworks, performance optimization, and cloud-native data engineering. Experience leveraging AI coding assistants to accelerate development and improve engineering productivity is highly desirable.

Key ResponsibilitiesBig Data Pipeline Development

Design, develop, and maintain scalable batch and streaming data pipelines.
Build high-performance ETL/ELT workflows for large-scale data processing.
Develop reusable and maintainable data engineering frameworks.
Integrate structured, semi-structured, and unstructured data from multiple sources.
Ensure high availability, scalability, and reliability of data pipelines.

Databricks & Delta Lake

Design and implement modern Lakehouse architectures using Databricks and Delta Lake.
Build and optimize Spark workloads using Scala and PySpark.
Implement Delta Live Tables, schema evolution, and ACID-compliant data processing.
Optimize Delta tables through partitioning, indexing, and file compaction.
Support analytics, reporting, and machine learning workloads.

AWS Data Engineering

Develop data integration solutions using AWS Glue and Amazon EMR.
Build serverless ETL jobs and orchestrate large-scale data processing workflows.
Integrate with Amazon S3, IAM, CloudWatch, and other AWS services.
Optimize cloud infrastructure for performance and cost efficiency.
Support cloud migration and modernization initiatives.

Snowflake Migration

Lead migration of enterprise data warehouses to Snowflake.
Design migration strategies, data transformation logic, and validation processes.
Optimize data models and workloads for Snowflake performance.
Ensure data integrity, security, and minimal downtime during migration.
Collaborate with business and infrastructure teams throughout migration projects.

Data Validation & Profiling

Perform data profiling, reconciliation, and validation across enterprise datasets.
Implement automated validation and reconciliation processes.
Identify and resolve data inconsistencies and quality issues.
Develop reusable validation frameworks for production pipelines.
Support governance and compliance initiatives through data quality monitoring.

Performance Optimization

Optimize Spark applications, SQL queries, and distributed processing workloads.
Improve job execution time through partitioning, caching, and resource tuning.
Monitor pipeline performance and resolve bottlenecks.
Implement scalable data storage strategies using Parquet and Delta formats.
Continuously improve system efficiency and operational reliability.

AI-Assisted Development

Leverage AI Coding Assistants to improve development productivity and code quality.
Apply AI-assisted code generation, testing, debugging, and documentation practices.
Evaluate emerging AI tools and integrate them into engineering workflows.
Promote engineering best practices while maintaining secure and reliable code.

Collaboration & Leadership

Work closely with Data Architects, Data Scientists, Analysts, and DevOps teams.
Participate in architecture discussions and technical design reviews.
Mentor junior engineers and establish data engineering best practices.
Contribute to Agile/Scrum ceremonies and continuous improvement initiatives.

Required SkillsProgramming

Scala
Python
PySpark
SQL

Big Data Technologies

Apache Spark
Databricks
Delta Lake
AWS Glue
Amazon EMR
Hadoop Ecosystem (Preferred)

Data Engineering

Big Data Pipeline Development
ETL/ELT Development
Data Validation
Data Profiling
Data Transformation
Data Integration

Data Warehousing

Snowflake
Snowflake Migration
Data Lakehouse
Data Warehouse Modernization

File Formats

Parquet
Delta Format
Avro (Preferred)
ORC (Preferred)

Databases

PostgreSQL
SQL Server
MySQL
MongoDB (Preferred)

Cloud Platforms

AWS
Amazon S3
IAM
CloudWatch
Databricks on AWS

Data Quality

Data Quality Frameworks
Data Governance
Metadata Management (Preferred)
Data Lineage (Preferred)

DevOps & Tools

Git
Jenkins
Azure DevOps
GitHub Actions
CI/CD Pipelines

AI Productivity Tools

AI Coding Assistants (GitHub Copilot, Amazon Q, Cursor, or similar)
Prompt Engineering for Development
AI-Assisted Code Review

Preferred Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.
5–10 years of experience in Big Data Engineering and cloud-based data platforms.
Strong expertise in Scala, PySpark, AWS Glue, Databricks, and Delta Lake.
Experience with Amazon EMR, Snowflake migration, and enterprise-scale ETL development.
Strong knowledge of distributed computing, Spark optimization, and data quality frameworks.
Experience working with Agile/Scrum development methodologies.
Excellent analytical, troubleshooting, and communication skills.

Preferred Certifications

Databricks Certified Data Engineer Professional
AWS Certified Data Engineer – Associate
AWS Certified Solutions Architect – Associate (Preferred)
Snowflake SnowPro Core Certification
Microsoft Certified: Azure Data Engineer Associate (DP-203) (Preferred)
Apache Spark Developer Certification (Preferred)

Work Location: Hybrid remote in Noida, Uttar Pradesh

Quick apply

Refine Your Search

python senior technical lead devops jobs in badkhal lake delhi delhi

Senior Big Data Engineer (Scala | PySpark | AWS Glue | Databricks)

Senior AI Architect

Senior Product Engineer

Lead Platform Engineer

Senior Software Engineer

Senior Data Solution Architect

Cloud Technology Consultant - AWS Cloud, Director

Senior AI Platform Engineer

Senior Consultant | APS - BY | Noida | Supply Chain & Network Operations

Senior Associate, FinanceTransformation Data Engineer - Global Capability Center

Senior Software Engineer - Full stack

Senior Software Engineer

Senior Analyst, Quality Assurance

Track Manager - Oracle Administration,PostgreSQL

Senior AI Engineer / Senior Machine Learning Specialist

Senior Software Engineer

Senior Associate, Business Intelligence Unit, GESS - Global Capability Center

SDE 1 (Backend developer)

Senior Associate Full stack + AI (Consumer Products AI)

Senior Cyber Security Specialist

I want to receive the latest job alerts for python senior technical lead devops in badkhal lake delhi delhi

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected