Remote Sr. big data engineer Jobs – 44 Open Jobs Today

PySPark /Spark & Dataproc Senior Engineer
HoonarTek —Remote
- Full-time
- Remote
- Research
- SQL
- Scripting
12d
Manager / Area Manager Artificial Intelligence
Tata Steel —Remote
- Remote
- Azure
- Master's degree
- SQL
Senior Staff Engineer, Salesforce Health Cloud
Nagarro —Remote
- Full-time
- Remote
- Azure
- Computer Science
- Salesforce
Quick apply
Senior Manager, Machine Learning
Twilio —Remote
- Remote
- Azure
- Doctoral degree
- Computer Science
- Paid time off
Presales Solutions Architect - ServiceNow
AHEAD —Remote
- Full-time
- Remote
- Salesforce
- Project management
- Bachelor's degree
- Health insurance
- Paid time off

More jobs to discover

Find similar jobs that you might be interested in.

Manager / Area Manager Artificial Intelligence
Tata Steel —Remote
The Context / Purpose of the Job: TSL is seeking an AI Engineer to lead our advancement toward Industry 5.0 by developing and implementing a comprehensive AI…
Sr. Product Manager - Template Library, Brand Board & Countdown Timer
HighLevel —Remote
B. Brand Board: Build and maintain HighLevel's single source of truth for business identity — capturing logos, colors, typography, and voice — and ensure those…

I want to receive the latest job alerts for sr. big data engineer in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

sr. big data engineer jobs near remote

Senior Engineer jobs in Remote

Machine Learning Engineer jobs in Remote

Ai Architect jobs in Remote

Solution Architect jobs in Remote

Senior Engineer jobs in Ahmedabad, Gujarat

Devops Engineer jobs in Mohali, Punjab

Senior Engineer jobs in Bangalore City, Bengaluru, Karnataka

Accountant, Senior jobs in Durgapur, West Bengal

Senior Engineer jobs in Gurugram, Haryana

Senior Engineer jobs in Noida, Uttar Pradesh

Senior Graphic Designer jobs in Kolkata, West Bengal

Design Engineer jobs in Ambala, Haryana

Machine Learning Engineer jobs in Nikol, Ahmedabad, Gujarat

Design Engineer Solidworks jobs in Tamil Nadu

Machine Learning Engineer jobs in Udaipur, Rajasthan

Machine Learning Engineer jobs in Calicut, Kerala

Estimation Engineer jobs in Pune, Maharashtra

Machine Learning Engineer jobs in Vasai, Maharashtra

Mechanical Engineer jobs in Rajasthan

Chatgpt Ai jobs in Bengaluru, Karnataka

PySPark /Spark & Dataproc Senior Engineer

HoonarTek
Remote

Apply Now

Job details

Full-time
12 days ago

Qualifications

CI/CD
Performance tuning
Business intelligence
Kubernetes
D3.js
Spark
Research
Ab Initio
SQL
Continuous integration
Scripting
Agile
Python
Debugging

Full job description

Hybrid, Bangalore, Pune

About Us

We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.

Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.

Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.

At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

How We Work?

Define, Design and Deliver (D3) is our in-house delivery philosophy. It’s culled from agile and rapid methodologies and focused on ‘just enough design’. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.

We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.

Job Description

Roles & Responsibilities

Design, develop, and maintain PySpark-based data processing pipelines
Perform migration and reconfiguration of Spark workloads across different execution environments (e.g., containers to managed platforms like Dataproc)
Execute and validate automated code conversion or migration utilities
Analyze and resolve code compatibility and runtime issues during platform transitions
Perform performance tuning and optimization of Spark jobs for:

Execution efficiency

Resource utilization

Cost effectiveness

Support benchmarking and performance analysis across environments
Troubleshoot failures and ensure stable and reliable job execution
Adhere to best practices for:

Distributed processing

Code modularity and maintainability

Collaborate with cross-functional teams for integration and deployment
Maintain documentation for code changes, configurations, and known issues

Primary Skillsets

Strong expertise in PySpark / Apache Spark
Experience with distributed data processing frameworks
Hands-on with Spark performance tuning and optimization techniques
Proficiency in:

Spark SQL

DataFrames / RDD operations

Understanding of Spark internals:

Execution plans, partitioning, shuffle operations

Experience with GCP services (Dataproc, GCS, BigQuery)
Exposure to containerized environments (Kubernetes / GKE)
Familiarity with automation scripting (Python, Shell)

Secondary Skillsets

Knowledge of cloud cost optimization principles
Experience with logging, monitoring, and debugging tools
Basic understanding of CI/CD pipelines

Job Requirement

Roles & Responsibilities

Design, develop, and maintain PySpark-based data processing pipelines
Perform migration and reconfiguration of Spark workloads across different execution environments (e.g., containers to managed platforms like Dataproc)
Execute and validate automated code conversion or migration utilities
Analyze and resolve code compatibility and runtime issues during platform transitions
Perform performance tuning and optimization of Spark jobs for:

Execution efficiency

Resource utilization

Cost effectiveness

Support benchmarking and performance analysis across environments
Troubleshoot failures and ensure stable and reliable job execution
Adhere to best practices for:

Distributed processing

Code modularity and maintainability

Collaborate with cross-functional teams for integration and deployment
Maintain documentation for code changes, configurations, and known issues

Primary Skillsets

Strong expertise in PySpark / Apache Spark
Experience with distributed data processing frameworks
Hands-on with Spark performance tuning and optimization techniques
Proficiency in:

Spark SQL

DataFrames / RDD operations

Understanding of Spark internals:

Execution plans, partitioning, shuffle operations

Experience with GCP services (Dataproc, GCS, BigQuery)
Exposure to containerized environments (Kubernetes / GKE)
Familiarity with automation scripting (Python, Shell)

Secondary Skillsets

Knowledge of cloud cost optimization principles
Experience with logging, monitoring, and debugging tools
Basic understanding of CI/CD pipelines

Apply Now

Refine Your Search

sr. big data engineer jobs in remote

PySPark /Spark & Dataproc Senior Engineer

Manager / Area Manager Artificial Intelligence

Senior Staff Engineer, Salesforce Health Cloud

Senior Manager, Machine Learning

Presales Solutions Architect - ServiceNow

More jobs to discover

I want to receive the latest job alerts for sr. big data engineer in remote

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected