<
- Experience: 2 to 4 years in data engineering with significant hands-on experience in Go (Golang).
- Apache Beam & Dataflow: Strong experience with Apache Beam SDK (Go preferred) and deploying jobs on Google Cloud Dataflow.
- GCP Services: Proficiency with BigQuery, Pub/Sub, and Cloud Storage.
- Data Technologies: Experience with real-time streaming (Kafka or Pub/Sub) and strong SQL skills.
- DevOps & Automation: Familiarity with Docker, Kubernetes, Terraform, or Ansible is preferred.
- Methodologies: Experience working in Agile or Scrum environments. >
< - Design and deploy data processing pipelines using Apache Beam Go SDK on Google Dataflow.
- Integrate GCP services including BigQuery, Pub/Sub, Cloud Storage, and BigTable.
- Develop and optimize batch and real-time streaming pipelines.
- Monitor and troubleshoot pipelines using Cloud Monitoring (Stackdriver) to ensure cost-effectiveness and reliability.
- Maintain code quality and implement testing best practices for Beam pipelines.
- Collaborate with data scientists and analysts to translate requirements into technical solutions.
- Provide technical guidance and mentorship to junior team members. >
Desired Skills
Apache Web Server | DevOps | Apache | GCP - IT Service Management Consulting
Desired Candidate Profile
Qualifications : BACHELOR OF ENGINEERING
