Home Based Sr. big data engineer Jobs – 47 Open Jobs Today

PySPark /Spark & Dataproc Senior Engineer
HoonarTek —Remote
- Full-time
- Remote
- Research
- SQL
- Scripting
Senior Data Engineer, Mandarin
A5 Labs —Remote
- Remote
- Computer Science
- English
- Master's degree
Manager / Area Manager Artificial Intelligence
Tata Steel —Remote
- Remote
- Azure
- Master's degree
- SQL
Senior Consulting Engineer - India
Clickhouse —Remote
- Remote
- Azure
- AWS
- Project management
Presales Solutions Architect - ServiceNow
AHEAD —Remote
- Full-time
- Remote
- Salesforce
- Project management
- Bachelor's degree
- Health insurance
- Paid time off
Senior Cloud Engineers
MNJ Software —Remote
- Full-time
- Remote
- Azure
- English
- Master's degree
- Work from home
Senior Staff Engineer, Salesforce Health Cloud
Nagarro —Remote
- Full-time
- Remote
- Azure
- Computer Science
- Salesforce
Quick apply
Senior Data Engineer
TARRYRISE HOME & STAFF SERVICES —Remote
- Full-time
- Remote
- Azure
- Computer Science
- DevOps
Quick apply
2d
Senior Data Engineer
Innovecture —Remote
- Remote
- SQL
- AWS
- APIs
Quick apply
2d

I want to receive the latest job alerts for sr. big data engineer in home based

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

sr. big data engineer jobs near home based

Cloud Engineer jobs in Remote

Data Engineer jobs in Remote

Senior Engineer jobs in Remote

Ai Architect jobs in Remote

Solution Architect jobs in Remote

Senior Accountant jobs in Ahmedabad, Gujarat

Senior Citizen, Part Time jobs in Bhubaneswar, Orissa

Senior Sales Executive jobs in Hyderabad, Telangana

Mechanical Engineer, Bokaro jobs in Jharkhand

Government Network Engineer jobs in Gurugram, Haryana

Cloud Engineer jobs in Anna Nagar, Chennai, Tamil Nadu

Aws Cloud Practitioner jobs in Mumbai, Maharashtra

Cloud Engineer jobs in Madhya Pradesh

Cloud Engineer jobs in Pune, Maharashtra

Cloud Engineer jobs in New Delhi, Delhi

Sales Engineer jobs in Ahmedabad, Gujarat

Data Engineer jobs in Ranchi, Jharkhand

Data Engineer jobs in Jadavpur, Kolkata, West Bengal

Civil Engineer jobs in Yelahanka, Bengaluru, Karnataka

Work From Home, Data Entry jobs in Mohali, Punjab

PySPark /Spark & Dataproc Senior Engineer

HoonarTek
Remote

Apply Now

Job details

Full-time

Qualifications

CI/CD
Performance tuning
Business intelligence
Kubernetes
D3.js
Spark
Research
Ab Initio
SQL
Continuous integration
Scripting
Agile
Python
Debugging

Full job description

Hybrid, Bangalore, Pune

About Us

We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.

Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.

Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.

At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

How We Work?

Define, Design and Deliver (D3) is our in-house delivery philosophy. It’s culled from agile and rapid methodologies and focused on ‘just enough design’. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.

We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.

Job Description

Roles & Responsibilities

Design, develop, and maintain PySpark-based data processing pipelines
Perform migration and reconfiguration of Spark workloads across different execution environments (e.g., containers to managed platforms like Dataproc)
Execute and validate automated code conversion or migration utilities
Analyze and resolve code compatibility and runtime issues during platform transitions
Perform performance tuning and optimization of Spark jobs for:

Execution efficiency

Resource utilization

Cost effectiveness

Support benchmarking and performance analysis across environments
Troubleshoot failures and ensure stable and reliable job execution
Adhere to best practices for:

Distributed processing

Code modularity and maintainability

Collaborate with cross-functional teams for integration and deployment
Maintain documentation for code changes, configurations, and known issues

Primary Skillsets

Strong expertise in PySpark / Apache Spark
Experience with distributed data processing frameworks
Hands-on with Spark performance tuning and optimization techniques
Proficiency in:

Spark SQL

DataFrames / RDD operations

Understanding of Spark internals:

Execution plans, partitioning, shuffle operations

Experience with GCP services (Dataproc, GCS, BigQuery)
Exposure to containerized environments (Kubernetes / GKE)
Familiarity with automation scripting (Python, Shell)

Secondary Skillsets

Knowledge of cloud cost optimization principles
Experience with logging, monitoring, and debugging tools
Basic understanding of CI/CD pipelines

Job Requirement

Roles & Responsibilities

Design, develop, and maintain PySpark-based data processing pipelines
Perform migration and reconfiguration of Spark workloads across different execution environments (e.g., containers to managed platforms like Dataproc)
Execute and validate automated code conversion or migration utilities
Analyze and resolve code compatibility and runtime issues during platform transitions
Perform performance tuning and optimization of Spark jobs for:

Execution efficiency

Resource utilization

Cost effectiveness

Support benchmarking and performance analysis across environments
Troubleshoot failures and ensure stable and reliable job execution
Adhere to best practices for:

Distributed processing

Code modularity and maintainability

Collaborate with cross-functional teams for integration and deployment
Maintain documentation for code changes, configurations, and known issues

Primary Skillsets

Strong expertise in PySpark / Apache Spark
Experience with distributed data processing frameworks
Hands-on with Spark performance tuning and optimization techniques
Proficiency in:

Spark SQL

DataFrames / RDD operations

Understanding of Spark internals:

Execution plans, partitioning, shuffle operations

Experience with GCP services (Dataproc, GCS, BigQuery)
Exposure to containerized environments (Kubernetes / GKE)
Familiarity with automation scripting (Python, Shell)

Secondary Skillsets

Knowledge of cloud cost optimization principles
Experience with logging, monitoring, and debugging tools
Basic understanding of CI/CD pipelines

Apply Now

Refine Your Search

sr. big data engineer jobs in home based

PySPark /Spark & Dataproc Senior Engineer

Senior Data Engineer, Mandarin

Manager / Area Manager Artificial Intelligence

Senior Consulting Engineer - India

Presales Solutions Architect - ServiceNow

Senior Cloud Engineers

Senior Staff Engineer, Salesforce Health Cloud

Senior Data Engineer

Senior Data Engineer

I want to receive the latest job alerts for sr. big data engineer in home based

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected