Up Solution architect data and analytics Jobs – 168 Open Jobs Today

Senior Data Engineer
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- SQL
Quick apply
3h
Sr Cloud Data Engineer
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- Software troubleshooting
Quick apply
4h
Senior Cloud DBA
Websenor —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- DevOps
Quick apply
1h
Senior Cloud DBA - PostgreSQL & Databricks Lakehouse
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Remote
- Azure
- Computer Science
- DevOps
Quick apply
2h
Staff Software Engineer
R1 RCM, Inc. —Noida, Uttar Pradesh
- Full-time
- Azure
- Computer Science
- SQL
Lead Assistant Manager
EXL Service —Noida, Uttar Pradesh
- Full-time
- Azure
- Computer Science
- Windows
5d
Senior / Principal DevOps / Platform Engineer
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- Software troubleshooting
Quick apply
Senior Engineer–AI Sustainable building design
WSP —Noida, Uttar Pradesh
- Hybrid work
- Engineering
- Analysis skills
- Machine learning
Engineering Manager- Data Science (Search and Match)
BOLD LLC —Noida, Uttar Pradesh
- Management
- Master's degree
- SQL
- Health insurance
- Paid time off
Senior Specialist - Cloud CC Delivery Lead
EXL Service —Noida, Uttar Pradesh
- Full-time
- Computer Science
- Master's degree
- Bachelor's degree
5d
Consultant - SME- Coupa CCW
CLOUDSUFI —Noida, Uttar Pradesh
- APIs
- Agile
Quick apply
Senior Firmware Engineer
Microsoft —Noida, Uttar Pradesh
- Full-time
- Azure
- Computer Science
- Windows
9d
Marketo Consultant
VML/WPP Enterprise Solutions —Noida, Uttar Pradesh
- Azure
- Salesforce
- Java
Quick apply
1d
Quadient Workflow Engineer (CCM, Azure & BlueCrest Integration)
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Remote
- Azure
- Computer Science
- DevOps
Quick apply
6d
Senior AI Engineer – (Land Services)
WSP —Noida, Uttar Pradesh
- Hybrid work
- Azure
- Computer Science
- Master's degree
13d
Senior Full Stack Developer (React.js | Node.js | Microsoft Azure)
WebSenor InfoTech —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Azure
- Computer Science
- Software troubleshooting
Quick apply
Associate Director - Industry Advisory 3
Genpact India Pvt. Ltd. —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- PMP
- Salesforce
- English
Quick apply
Delivery Head - Public Sector
Saaki Argus & Averil Consulting —Noida, Uttar Pradesh
- Project management
- Leadership
- Communication skills
Quick apply
AWS Cloud DevOps Lead
Solutionara Private Limited —Noida, Uttar Pradesh
- ₹5,00,000 - ₹17,00,000 a year
- Full-time
- Azure
- DevOps
- AWS
- Paid time off
- Cell phone reimbursement
Quick apply
Senior PHP Developer Noida - Hybrid • Hybrid
Daxko —Noida, Uttar Pradesh
- Full-time
- Hybrid work
- Databases
- SQL
- AWS
3d

I want to receive the latest job alerts for solution architect data and analytics in up

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

solution architect data and analytics jobs near up

Cloud Engineer jobs in Noida, Uttar Pradesh

Data Engineer jobs in Noida, Uttar Pradesh

Ai Developer jobs in Noida, Uttar Pradesh

PHP Developer jobs in Noida, Uttar Pradesh

Delivery Manager jobs in Noida, Uttar Pradesh

Firmware Engineer jobs in Bengaluru, Karnataka

Devops Engineer jobs in Noida, Uttar Pradesh

Associate Director jobs in Noida, Uttar Pradesh

Full Stack Developer jobs in Noida, Uttar Pradesh

Data Science Manager jobs in Noida, Uttar Pradesh

Senior Devops Engineer jobs in Bengaluru, Karnataka

Senior Devops Engineer jobs in Shivajinagar, Pune, Maharashtra

Mep Engineer jobs in Chennai, Tamil Nadu

Senior Devops Engineer jobs in Mohali, Punjab

Devops Engineer jobs in Hyderabad, Telangana

Delivery Director jobs in Bengaluru, Karnataka

Part Time Delivery jobs in Bengaluru, Karnataka

Delivery Director jobs in Maharashtra

Art Director jobs in Delhi

Jio Mart , Delivery jobs in Ahmedabad, Gujarat

Senior Data Engineer

WebSenor InfoTech -
Noida, Uttar Pradesh

Quick apply

Job details

Full-time
3 hours ago

Qualifications

BCS
CI/CD
Azure
Computer Science
Spark
Git
SQL
Bachelor's degree
Continuous integration
Scrum
GitHub
APIs
Agile
Apache
Data science
AI
Python
Information Technology
Design patterns

Full job description

Job Description – Senior Data Engineer (Databricks + PySpark + ADF + Airflow)

Job Title: Senior Data Engineer
Experience: 7+ Years
Employment Type: Full-Time

Role Summary

We are seeking an experienced Senior Data Engineer to drive cloud data modernization initiatives and build scalable, reliable, and AI-ready data platforms. The ideal candidate will have strong hands-on expertise in Databricks, PySpark, Delta Lake, Azure Data Factory (ADF), Azure Logic Apps, and Apache Airflow, with a proven ability to design and manage enterprise-scale data pipelines and orchestration frameworks.

The role requires deep expertise in data engineering, workflow automation, pipeline reliability, cloud-native architectures, and end-to-end data lifecycle management. The candidate will collaborate with data architects, data scientists, analysts, and engineering teams to deliver high-performance data solutions.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using:
Databricks (PySpark)
Azure Data Factory (ADF)
Azure Logic Apps
Apache Airflow
Build and manage end-to-end orchestration frameworks integrating Airflow DAGs with ADF and Logic Apps.
Develop advanced workflow orchestration patterns including:
Event-driven workflows
Micro-batch processing
Hybrid scheduling models
Dependency-based pipeline execution
Design and implement high-performance ETL/ELT pipelines using:
Databricks
PySpark
Delta Lake architecture
Develop scalable data transformation frameworks for large-volume structured and semi-structured datasets.
Implement pipeline dependency management, monitoring, error handling, and operational reliability practices.
Integrate data pipelines with Azure services including:
Azure Data Lake Storage Gen2 (ADLS Gen2)
Azure Blob Storage
Azure event-driven services
Build and maintain data workflow automation using Azure Logic Apps and Airflow orchestration.
Implement data observability solutions including:
Pipeline monitoring
Logging
Alerting
Failure detection and recovery mechanisms
Optimize data pipelines for:
Performance
Scalability
Reliability
Cost efficiency
Implement CI/CD practices for data pipelines using:
GitHub Actions
Source control workflows
Automated deployment processes
Ensure data quality, governance, security, and compliance across enterprise data platforms.
Collaborate with Data Scientists and AI/ML teams to prepare data platforms for analytics, ML, and GenAI workloads.
Support data platform modernization and migration initiatives.
Mentor junior data engineers and establish best practices for pipeline development, orchestration, and operational excellence.
Participate in architecture discussions, design reviews, and technical solution planning.

Required QualificationsEducation

Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or related discipline.

Experience

7+ years of experience in Data Engineering.
Strong experience designing and implementing enterprise-scale data platforms.
Proven experience building cloud-native data solutions and automated workflows.
Experience managing complex data pipelines in production environments.

Must-Have Technical SkillsDatabricks & PySpark

Strong hands-on experience with:

Databricks
PySpark
Delta Lake architecture
Distributed data processing
Spark optimization techniques
Large-scale ETL/ELT development

Azure Data Engineering

Highly proficient in:

Azure Data Factory (ADF)
Azure Logic Apps
Azure Data Lake Storage Gen2 (ADLS Gen2)
Azure Blob Storage
Azure cloud-native data architectures

Workflow Orchestration

Strong experience with:

Apache Airflow
DAG development
Workflow scheduling
Pipeline dependency management
Job orchestration
Failure handling and recovery strategies

Programming & Database Skills

Strong programming skills in:

Python
Advanced SQL

Experience with:

Data transformation frameworks
Query optimization
Data processing automation

ETL/ELT & Data Architecture

Strong understanding of:

ETL/ELT design patterns
Data pipeline architecture
Data Lakehouse concepts
Data modeling
Data quality frameworks
Data governance practices

Preferred Qualifications

Experience with event-driven architecture and API-based integrations.
Exposure to AI/ML data engineering workflows.
Experience supporting ML pipelines and MLflow.
Knowledge of Data Lakehouse architecture and governance frameworks.
Experience with Azure Databricks ecosystem.
Familiarity with monitoring and observability tools.
Azure or Databricks certifications preferred.
Experience working in Agile/Scrum environments.

Key Competencies

Databricks Engineering
PySpark Development
Azure Data Engineering
Data Pipeline Architecture
Workflow Orchestration
Airflow DAG Development
ETL/ELT Development
Delta Lake Architecture
Cloud Data Modernization
Pipeline Reliability Engineering
Data Governance & Security
Performance Optimization
Technical Leadership

Role Outcomes

The successful candidate will:

Build scalable and reliable cloud data platforms.
Deliver high-performance Databricks and PySpark-based data solutions.
Establish robust orchestration frameworks using Airflow, ADF, and Logic Apps.
Enable AI/ML-ready data ecosystems through modern engineering practices.
Improve operational reliability, automation, and efficiency of enterprise data workflows.

Work Location: Hybrid remote in Noida, Uttar Pradesh (Noida)

Quick apply

Refine Your Search

solution architect data and analytics jobs in up

Senior Data Engineer

Sr Cloud Data Engineer

Senior Cloud DBA

Senior Cloud DBA - PostgreSQL & Databricks Lakehouse

Staff Software Engineer

Lead Assistant Manager

Senior / Principal DevOps / Platform Engineer

Senior Engineer–AI Sustainable building design

Engineering Manager- Data Science (Search and Match)

Senior Specialist - Cloud CC Delivery Lead

Consultant - SME- Coupa CCW

Senior Firmware Engineer

Marketo Consultant

Quadient Workflow Engineer (CCM, Azure & BlueCrest Integration)

Senior AI Engineer – (Land Services)

Senior Full Stack Developer (React.js | Node.js | Microsoft Azure)

Associate Director - Industry Advisory 3

Delivery Head - Public Sector

AWS Cloud DevOps Lead

Senior PHP Developer Noida - Hybrid • Hybrid

I want to receive the latest job alerts for solution architect data and analytics in up

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected