Data Engineering Architect – Key Requirements & Responsibilities
- 12+ years of experience in Data Engineering, delivering large-scale enterprise data platforms and modernization initiatives.
- 5+ years of hands-on experience with Google Cloud Platform (GCP) and 3+ years in Data Architecture/Solution Architecture roles.
- Strong expertise in designing and implementing end-to-end data lake and analytics architectures using GCP services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
- Extensive hands-on Python development experience for data engineering and automation solutions.
- Proven experience building scalable batch and real-time data ingestion pipelines using Dataflow, Pub/Sub, Apache Spark, and related technologies.
- Strong knowledge of GCP cost optimization, performance tuning, IAM, security, governance, and metadata management.
- Experience with Dataplex, Data Catalog, and enterprise data governance frameworks.
- Hands-on experience with containerization technologies and CI/CD implementation using GitHub Actions.
- Ability to integrate cloud data platforms with enterprise systems such as SAP S/4HANA and Salesforce for batch and streaming workloads.
- Provide architectural leadership, define best practices, and mentor engineering teams on GCP and data engineering standards.
- Collaborate with business stakeholders, data scientists, and engineering teams to translate business requirements into scalable technical solutions.
- Ensure data security, compliance, access controls, and operational excellence across the platform.
Preferred: GCP Professional Data Engineer/Cloud Architect certifications, Apache Spark/Python certifications, and experience with BI tools such as Tableau and Power BI.
Pay: ₹400,000.00 - ₹500,000.00 per month
Work Location: Hybrid remote in Bengaluru, Karnataka (Bengaluru Urban District)
