Up Azure data engineer Jobs – 102 Open Jobs Today

Senior Big Data Engineer (Scala | PySpark | AWS Glue | Databricks)
WebSenor —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- Master's degree
Quick apply
9d
Azure DevOps Engineer
WebSenor —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- DevOps
Quick apply
13d
Data Engineer – Scala
Technology Next —Noida, Uttar Pradesh
- ₹80,000 - ₹1,00,000 a month
- Full-time
- Azure
- SQL
- AWS
Quick apply
2d
Senior Data Engineer
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- SQL
Quick apply
3d
IN_Senior Associate_Azure Data Engineering _D&A_Advisory_Noida
PwC —Noida, Uttar Pradesh
- Full-time
- Azure
- DevOps
- Master's degree
Sr Cloud Data Engineer
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- Software troubleshooting
Quick apply
3d
Data Engineer ||
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- DevOps
Quick apply
3d
Data Engineer
RxLogix —Noida, Uttar Pradesh
- Azure
- Oracle
- Computer Science
Senior Advanced Data Engineer
Cotality —Noida, Uttar Pradesh
- Full-time
- Azure
- Software troubleshooting
- B.Sc
- Paid holidays
- Health insurance
BlueCrest ADF Workflow Engineer (Azure Integration & Document Processing)
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- DevOps
Quick apply
azure cloud solution architect( DBA and data modernization )
WebSenor —Noida, Uttar Pradesh
- Full-time
- Remote
- Azure
- Computer Science
- Master's degree
Quick apply
4d
Cloud Engineer
Zones —Noida, Uttar Pradesh
- Full-time
- Azure
- Windows
- Scripting
- Health insurance
- Life insurance
Quick apply
Azure Cloud Solution Architect (DBA & Data)
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- DevOps
Quick apply
9d
Senior Data Engineer
Adobe —Noida, Uttar Pradesh
- Full-time
- Azure
- Computer Science
- Databases
12d
Sr Data Engineering Analyst-Python, Scala, Azure
Optum —Noida, Uttar Pradesh
- Full-time
- Azure
- Computer Science
- Master's degree
- Health insurance
13d
Quadient Workflow Engineer (CCM, Azure & BlueCrest Integration)
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- DevOps
Quick apply
AI Data Engineer
Websenor —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Master's degree
- SQL
Quick apply
Senior Data Engineer – Data Modeling & Oracle Cloud Migration
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Oracle
- Computer Science
Quick apply
9d
BlueCrest ADF Workflow Engineer (Azure Integration & Document Processing)
Websenor —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- DevOps
- SQL
Quick apply
Senior Data Engineer – GenAI & Unstructured Data Pipelines
WebSenor —Noida, Uttar Pradesh
- Full-time
- Azure
- Computer Science
- Master's degree
Quick apply

I want to receive the latest job alerts for azure data engineer in up

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

azure data engineer jobs near up

Data Engineer jobs in Noida, Uttar Pradesh

Cloud Engineer jobs in Noida, Uttar Pradesh

Documentation Engineer jobs in Noida, Uttar Pradesh

Senior Data Analyst jobs in Noida, Uttar Pradesh

Devops Engineer jobs in Noida, Uttar Pradesh

Data Scientist jobs in Bengaluru, Karnataka

Big Data Architect jobs in Noida, Uttar Pradesh

Data Engineer jobs in Kochi, Kerala

Data Science Internship jobs in Bengaluru, Karnataka

Data Analyst, Reliance Jio Infocomm jobs in Mumbai, Maharashtra

Data Engineer jobs in Navi Mumbai, Maharashtra

Structural Engineer jobs in Coimbatore, Tamil Nadu

Data Engineer jobs in K. R. Puram, Bengaluru, Karnataka

Data Engineer jobs in Ranchi, Jharkhand

Data Entry jobs in Badlapur, Maharashtra

Cloud Engineer jobs in Pune H.o, Pune, Maharashtra

Cloud Engineer jobs in Mumbai, Maharashtra

Fresher Civil Engineer jobs in Bengaluru, Karnataka

Cloud Engineer jobs in Janakpuri, Delhi, Delhi

Cloud Engineer jobs in Delhi

Senior Big Data Engineer (Scala | PySpark | AWS Glue | Databricks)

WebSenor
Noida, Uttar Pradesh

Quick apply

Job details

Full-time
9 days ago

Qualifications

CI/CD
Cloud infrastructure
Azure
Computer Science
Big data
Spark
AWS Certification
Microsoft SQL Server
Git
AWS Certified Solutions Architect – Associate
MongoDB
Master's degree
SQL
AWS
Bachelor's degree
Machine learning
PostgreSQL
Distributed systems
Scala
Continuous integration
Azure Certification
Scrum
GitHub
ETL
Agile
S3
Metadata
AI
Jenkins
Communication skills
Python
MySQL
AWS Certified Solutions Architect – Professional
Identity & access management
Hadoop
Information Technology

Full job description

We are seeking an experienced Senior Big Data Engineer with expertise in Scala, PySpark, AWS Glue, Databricks, Delta Lake, EMR, Snowflake Migration, and Big Data Pipeline Development. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, modernizing enterprise data platforms, and supporting cloud-based analytics and AI initiatives.

The candidate should have strong experience in distributed data processing, ETL/ELT development, data quality frameworks, performance optimization, and cloud-native data engineering. Experience leveraging AI coding assistants to accelerate development and improve engineering productivity is highly desirable.

Key ResponsibilitiesBig Data Pipeline Development

Design, develop, and maintain scalable batch and streaming data pipelines.
Build high-performance ETL/ELT workflows for large-scale data processing.
Develop reusable and maintainable data engineering frameworks.
Integrate structured, semi-structured, and unstructured data from multiple sources.
Ensure high availability, scalability, and reliability of data pipelines.

Databricks & Delta Lake

Design and implement modern Lakehouse architectures using Databricks and Delta Lake.
Build and optimize Spark workloads using Scala and PySpark.
Implement Delta Live Tables, schema evolution, and ACID-compliant data processing.
Optimize Delta tables through partitioning, indexing, and file compaction.
Support analytics, reporting, and machine learning workloads.

AWS Data Engineering

Develop data integration solutions using AWS Glue and Amazon EMR.
Build serverless ETL jobs and orchestrate large-scale data processing workflows.
Integrate with Amazon S3, IAM, CloudWatch, and other AWS services.
Optimize cloud infrastructure for performance and cost efficiency.
Support cloud migration and modernization initiatives.

Snowflake Migration

Lead migration of enterprise data warehouses to Snowflake.
Design migration strategies, data transformation logic, and validation processes.
Optimize data models and workloads for Snowflake performance.
Ensure data integrity, security, and minimal downtime during migration.
Collaborate with business and infrastructure teams throughout migration projects.

Data Validation & Profiling

Perform data profiling, reconciliation, and validation across enterprise datasets.
Implement automated validation and reconciliation processes.
Identify and resolve data inconsistencies and quality issues.
Develop reusable validation frameworks for production pipelines.
Support governance and compliance initiatives through data quality monitoring.

Performance Optimization

Optimize Spark applications, SQL queries, and distributed processing workloads.
Improve job execution time through partitioning, caching, and resource tuning.
Monitor pipeline performance and resolve bottlenecks.
Implement scalable data storage strategies using Parquet and Delta formats.
Continuously improve system efficiency and operational reliability.

AI-Assisted Development

Leverage AI Coding Assistants to improve development productivity and code quality.
Apply AI-assisted code generation, testing, debugging, and documentation practices.
Evaluate emerging AI tools and integrate them into engineering workflows.
Promote engineering best practices while maintaining secure and reliable code.

Collaboration & Leadership

Work closely with Data Architects, Data Scientists, Analysts, and DevOps teams.
Participate in architecture discussions and technical design reviews.
Mentor junior engineers and establish data engineering best practices.
Contribute to Agile/Scrum ceremonies and continuous improvement initiatives.

Required SkillsProgramming

Scala
Python
PySpark
SQL

Big Data Technologies

Apache Spark
Databricks
Delta Lake
AWS Glue
Amazon EMR
Hadoop Ecosystem (Preferred)

Data Engineering

Big Data Pipeline Development
ETL/ELT Development
Data Validation
Data Profiling
Data Transformation
Data Integration

Data Warehousing

Snowflake
Snowflake Migration
Data Lakehouse
Data Warehouse Modernization

File Formats

Parquet
Delta Format
Avro (Preferred)
ORC (Preferred)

Databases

PostgreSQL
SQL Server
MySQL
MongoDB (Preferred)

Cloud Platforms

AWS
Amazon S3
IAM
CloudWatch
Databricks on AWS

Data Quality

Data Quality Frameworks
Data Governance
Metadata Management (Preferred)
Data Lineage (Preferred)

DevOps & Tools

Git
Jenkins
Azure DevOps
GitHub Actions
CI/CD Pipelines

AI Productivity Tools

AI Coding Assistants (GitHub Copilot, Amazon Q, Cursor, or similar)
Prompt Engineering for Development
AI-Assisted Code Review

Preferred Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.
5–10 years of experience in Big Data Engineering and cloud-based data platforms.
Strong expertise in Scala, PySpark, AWS Glue, Databricks, and Delta Lake.
Experience with Amazon EMR, Snowflake migration, and enterprise-scale ETL development.
Strong knowledge of distributed computing, Spark optimization, and data quality frameworks.
Experience working with Agile/Scrum development methodologies.
Excellent analytical, troubleshooting, and communication skills.

Preferred Certifications

Databricks Certified Data Engineer Professional
AWS Certified Data Engineer – Associate
AWS Certified Solutions Architect – Associate (Preferred)
Snowflake SnowPro Core Certification
Microsoft Certified: Azure Data Engineer Associate (DP-203) (Preferred)
Apache Spark Developer Certification (Preferred)

Work Location: Hybrid remote in Noida, Uttar Pradesh

Quick apply

Refine Your Search

azure data engineer jobs in up

Senior Big Data Engineer (Scala | PySpark | AWS Glue | Databricks)

Azure DevOps Engineer

Data Engineer – Scala

Senior Data Engineer

IN_Senior Associate_Azure Data Engineering _D&A_Advisory_Noida

Sr Cloud Data Engineer

Data Engineer ||

Data Engineer

Senior Advanced Data Engineer

BlueCrest ADF Workflow Engineer (Azure Integration & Document Processing)

azure cloud solution architect( DBA and data modernization )

Cloud Engineer

Azure Cloud Solution Architect (DBA & Data)

Senior Data Engineer

Sr Data Engineering Analyst-Python, Scala, Azure

Quadient Workflow Engineer (CCM, Azure & BlueCrest Integration)

AI Data Engineer

Senior Data Engineer – Data Modeling & Oracle Cloud Migration

BlueCrest ADF Workflow Engineer (Azure Integration & Document Processing)

Senior Data Engineer – GenAI & Unstructured Data Pipelines

I want to receive the latest job alerts for azure data engineer in up

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected