Lead Data Engineer – GCP | Dataflow | Java | BigQuery
Experience: 7+ Years
Location: Chennai / Bangalore / Coimbatore
Work Mode: Hybrid
Job Type: Full-Time
Job Summary
We are looking for a highly skilled Lead Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery.
The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data processing solutions for enterprise applications.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using GCP services.
- Build and maintain real-time and batch data processing pipelines using Google Dataflow and Apache Beam.
- Develop robust backend data-processing solutions using Java.
- Work extensively with BigQuery for data warehousing, analytics, and performance optimization.
- Integrate data from multiple sources including APIs, databases, and streaming platforms.
- Optimize pipeline performance, cost, scalability, and reliability on GCP.
- Collaborate with Architects, Analysts, DevOps teams, and business stakeholders.
- Ensure data quality, governance, monitoring, and security best practices.
- Troubleshoot production issues and implement scalable long-term solutions.
Required Skills
- 7+ years of relevant Data Engineering experience.
- Strong hands-on experience with Google Cloud Platform (GCP).
- Expertise in Google Dataflow and Apache Beam.
- Strong programming skills in Java.
- Hands-on experience with BigQuery.
- Experience building batch and streaming data pipelines.
- Strong knowledge of SQL and data modeling concepts.
- Experience with CI/CD, Git, and Agile methodologies.
- Strong problem-solving and debugging skills.
Good to Have
- Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka.
- Exposure to Python or Spark.
- Experience working with large-scale enterprise data platforms.
- GCP certification is an added advantage.
Preferred Qualification
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Job Location
Candidates should be available to work in a Hybrid model from:
- Chennai
- Bangalore
- Coimbatore
Apply Now
Interested candidates can apply with their updated resume, current CTC, expected CTC, notice period, and current location.
Pay: ₹70,000.00 per month
Work Location: In person
