Hiring: Lead Data Engineer – Python & GCP
Location: Remote
Employment Type: Contract
Experience: 10+ Years
About the Role
We are looking for a highly experienced Lead Data Engineer with deep expertise in Python, Google Cloud Platform (GCP), Data Engineering, and Solution Architecture. This role requires a strong technical leader who can engage directly with customers, gather requirements, architect enterprise-scale solutions, and drive end-to-end delivery of modern data platforms.
The ideal candidate should have hands-on experience building scalable ETL/ELT pipelines, real-time data processing frameworks, cloud-native architectures, and modern analytics ecosystems on GCP.
Key Responsibilities
- Lead requirements gathering, solution design, architecture, and delivery of enterprise data engineering solutions.
- Design, develop, and maintain scalable ETL/ELT pipelines using Python.
- Architect cloud-native data platforms leveraging GCP services and modern data engineering frameworks.
- Build real-time and batch data processing solutions using Dataflow, Spark, Kafka, and BigQuery.
- Design secure and scalable architectures involving GKE, Cloud Run, Load Balancers, API Management, and multi-cloud integrations.
- Implement data quality, governance, security, DLP, and sensitive data redaction strategies.
- Collaborate with business stakeholders, architects, and engineering teams to deliver high-impact data solutions.
- Provide technical leadership, mentoring, and post-production support.
Required SkillsData Engineering & Architecture
- Python (Expert Level)
- ETL / ELT Pipeline Development
- Data Modeling & Data Warehousing
- Enterprise Solution Architecture
- Real-time Data Processing
Google Cloud Platform (GCP)
- BigQuery
- Dataflow
- Cloud Composer (Airflow)
- Cloud Functions
- Cloud Run
- Google Cloud Storage (GCS)
- IAM
- GKE (Google Kubernetes Engine)
Data & Integration Technologies
- Apache Spark
- Apache Kafka
- FastAPI
- Airflow
- MongoDB
- Redis / Bigtable
- API Integration & Microservices
Advanced & Preferred Skills
- DBT
- APIGEE
- Multi-Cloud Architecture
- LLM/Generative AI Integration
- Data Loss Prevention (DLP)
- Kubernetes & Containerization
- Auto-scaling & High Availability Architectures
What We're Looking For
✔ 10+ years of experience in Data Engineering and Cloud Solutions
✔ Strong expertise in Python and GCP ecosystem
✔ Proven experience architecting enterprise-scale data platforms
✔ Experience working directly with clients and stakeholders
✔ Strong understanding of distributed systems, streaming platforms, and cloud-native architectures
✔ Ability to lead technical discussions, solution design, and delivery teams
Pay: ₹80,000.00 - ₹1,868,633.59 per month
Experience:
- Hiring: Lead Data Engineer – Python & GCP: 10 years (Required)
Work Location: Remote
