Remote Data engineer – python & gcp Jobs – 138 Open Jobs Today

PySPark /Spark & Dataproc Senior Engineer
HoonarTek —Remote
- Full-time
- Remote
- Research
- SQL
- Scripting
AI/ML Engineer/ 5 +years/ Remote
APPTESTIFY GLOBAL SERVICES PVT LTD —Remote
- ₹80,000 - ₹1,00,000 a month
- Remote
- Azure
- Doctoral degree
- Computer Science
Quick apply
Manager / Area Manager Artificial Intelligence
Tata Steel —Remote
- Remote
- Azure
- Master's degree
- SQL
Solutions Support Engineer
Wiz, Inc. —Remote
- Weekend availability
- Remote
- Azure
- Software troubleshooting
- Java
Quick apply
Principal Platform Engineer
Insight Software —Remote
- Full-time
- Remote
- Azure
- DevOps
- English
Incorta Developer
Yoda Technologies Pty Ltd —Remote
- ₹5,00,000 - ₹8,00,000 a year
- Full-time
- Remote
- Azure
- Oracle
- Computer Science
- Health insurance
- Paid time off
Quick apply
Machine Learning Engineer III
Avalara —Remote
- Remote
- Azure
- Computer Science
- Master's degree
- Health insurance
- Paid time off
Data Scientist - Connected vehicle
Codvo.ai —Remote
- Remote
- Azure
- Computer Science
- Master's degree
DevOps Engineer
openDoctor —Remote
- ₹15,00,000 - ₹20,00,000 a year
- Full-time
- Remote
- Software troubleshooting
- DevOps
- SQL
- Health insurance
- Paid time off
Quick apply
3d
DevOps Engineer
WIN Home Inspection —Remote
- Remote
- Azure
- DevOps
- AWS
Quick apply
Sr. Backend Engineer
YipitData —Remote
- Remote
- Azure
- Computer Science
- ERP systems
- Paid time off
AI Developer
SNS System —Remote
- Full-time
- Remote
- Azure
- AWS
- Machine learning
Staff Engineer
Spreetail —Remote
- Email
- Remote
- Azure
- DevOps
- System design
- Work from home
Quick apply
Software Development Engineer in Test III - Revex
HighLevel —Remote
- Full-time
- Remote
- System design
- Master's degree
- AWS
Lead Site Reliability Engineer
HighLevel —Remote
- Remote
- DevOps
- Databases
- AWS
Senior AI Engineer
Codvo.ai —Remote
- Remote
- Azure
- Computer Science
- Software troubleshooting
Detection and Response Engineer
Unisys —Remote
- Full-time
- Remote
- Analysis skills
- Scripting
- Communication skills
Senior Technical Consultant, Platform Engineering - Azure
AHEAD —Remote
- Full-time
- Remote
- Azure
- Computer Science
- DevOps
Staff SDE
EDB —Remote
- Remote
- Azure
- Oracle
- DevOps
Quick apply
Engineering Manager – Fullstack & AI Engineering
Codvo.ai —Remote
- Full-time
- Remote
- Azure
- Management
- Master's degree

I want to receive the latest job alerts for data engineer – python & gcp in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

PySPark /Spark & Dataproc Senior Engineer

HoonarTek
Remote

Apply Now

Job details

Full-time

Qualifications

CI/CD
Performance tuning
Business intelligence
Kubernetes
D3.js
Spark
Research
Ab Initio
SQL
Continuous integration
Scripting
Agile
Python
Debugging

Full job description

Hybrid, Bangalore, Pune

About Us

We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.

Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.

Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.

At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

How We Work?

Define, Design and Deliver (D3) is our in-house delivery philosophy. It’s culled from agile and rapid methodologies and focused on ‘just enough design’. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.

We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.

Job Description

Roles & Responsibilities

Design, develop, and maintain PySpark-based data processing pipelines
Perform migration and reconfiguration of Spark workloads across different execution environments (e.g., containers to managed platforms like Dataproc)
Execute and validate automated code conversion or migration utilities
Analyze and resolve code compatibility and runtime issues during platform transitions
Perform performance tuning and optimization of Spark jobs for:

Execution efficiency

Resource utilization

Cost effectiveness

Support benchmarking and performance analysis across environments
Troubleshoot failures and ensure stable and reliable job execution
Adhere to best practices for:

Distributed processing

Code modularity and maintainability

Collaborate with cross-functional teams for integration and deployment
Maintain documentation for code changes, configurations, and known issues

Primary Skillsets

Strong expertise in PySpark / Apache Spark
Experience with distributed data processing frameworks
Hands-on with Spark performance tuning and optimization techniques
Proficiency in:

Spark SQL

DataFrames / RDD operations

Understanding of Spark internals:

Execution plans, partitioning, shuffle operations

Experience with GCP services (Dataproc, GCS, BigQuery)
Exposure to containerized environments (Kubernetes / GKE)
Familiarity with automation scripting (Python, Shell)

Secondary Skillsets

Knowledge of cloud cost optimization principles
Experience with logging, monitoring, and debugging tools
Basic understanding of CI/CD pipelines

Job Requirement

Roles & Responsibilities

Design, develop, and maintain PySpark-based data processing pipelines
Perform migration and reconfiguration of Spark workloads across different execution environments (e.g., containers to managed platforms like Dataproc)
Execute and validate automated code conversion or migration utilities
Analyze and resolve code compatibility and runtime issues during platform transitions
Perform performance tuning and optimization of Spark jobs for:

Execution efficiency

Resource utilization

Cost effectiveness

Support benchmarking and performance analysis across environments
Troubleshoot failures and ensure stable and reliable job execution
Adhere to best practices for:

Distributed processing

Code modularity and maintainability

Collaborate with cross-functional teams for integration and deployment
Maintain documentation for code changes, configurations, and known issues

Primary Skillsets

Strong expertise in PySpark / Apache Spark
Experience with distributed data processing frameworks
Hands-on with Spark performance tuning and optimization techniques
Proficiency in:

Spark SQL

DataFrames / RDD operations

Understanding of Spark internals:

Execution plans, partitioning, shuffle operations

Experience with GCP services (Dataproc, GCS, BigQuery)
Exposure to containerized environments (Kubernetes / GKE)
Familiarity with automation scripting (Python, Shell)

Secondary Skillsets

Knowledge of cloud cost optimization principles
Experience with logging, monitoring, and debugging tools
Basic understanding of CI/CD pipelines

Apply Now

Refine Your Search

data engineer – python & gcp jobs in remote

PySPark /Spark & Dataproc Senior Engineer

AI/ML Engineer/ 5 +years/ Remote

Manager / Area Manager Artificial Intelligence

Solutions Support Engineer

Principal Platform Engineer

Incorta Developer

Machine Learning Engineer III

Data Scientist - Connected vehicle

DevOps Engineer

DevOps Engineer

Sr. Backend Engineer

AI Developer

Staff Engineer

Software Development Engineer in Test III - Revex

Lead Site Reliability Engineer

Senior AI Engineer

Detection and Response Engineer

Senior Technical Consultant, Platform Engineering - Azure

Staff SDE

Engineering Manager – Fullstack & AI Engineering

I want to receive the latest job alerts for data engineer – python & gcp in remote

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected