Role: GCP Data Engineer
Remote option:-yes
Mandatory Skill- SQL Server, Python, airflow, Hadoop, BigQuery, Data lake
**Billing Start date: Immediate
Shift Timings: 2 – 11 PM IST
Technical Lead
Hands-on Technical Lead to spearhead a Business As Usual (BAU) Data Engagement team owning the stability, reliability, and continuous improvement of Production data pipelines running on Google Cloud Platform.
Technical Lead will bridge the gap between technical execution and operational excellence managing the end-to-end data lifecycle from Data Lake to Dimensional/Fact tables, and ultimately to the Data warehouse. As a working lead the expectation is to mentor a Data Engineering team and dive into the code to implement SQL fixes, optimize DAGs and ensure bulletproof change management across the dev-to-prod lifecycle.
Key Responsibilities
Technical Leadership & Mentorship: Lead and guide an offshore BAU production support team ensuring seamless overlap with US working hours.
Hands-On Production Support: Act as the ultimate point of escalation for troubleshooting, debugging, and resolving pipeline failures for data issues.
Pipeline Management & Optimization: Oversee the data flow architecture (Data Lake → Dims/Facts) and execute complex SQL fixes, DAG updates, data backfills, and system validations.
Rigorous Change Control: Ensure all production deployments have comprehensive evidence, testing, and robust rollback plans before execution.
Continuous Improvement: Identify recurring issues in the data pipelines and implement proactive, automated solutions using Python and SQL to reduce technical debt and manual toil.
Required Skills & Experience
Experience: 8+ years of dedicated Data Engineering experience with a proven track record of acting in a Team Lead or Technical Lead capacity.
GCP Data Stack: Deep hands-on expertise in Google BigQuery including advanced concepts like Slowly Changing Dimensions (SCD Type 1/2), partitioning, clustering, and cost optimization.
Orchestration: Extensive experience building and maintaining complex DAGs in Apache Airflow / Cloud Composer including proficiency with Jinja templating.
Programming: Strong proficiency in Python for data manipulation, automation, and API integration.
Operational Excellence: Deep understanding of production support workflows, incident management, and strict ITIL/Change Control processes.
Collaboration: Excellent communication skills with the ability to provide reliable overlap with standard US working hours.
Preferred Qualifications
Data Modeling: Strong foundational knowledge of the Kimball Data Warehouse methodology (Star Schemas, Dimensions, Facts).
Source Systems: Experience extracting, transforming, and loading data from Salesforce. (Nice to Have)
Global Teams: Prior experience leading, mentoring, or collaborating with offshore BAU/Support engineering teams.
SR NO Skills Experience Rating
1 Google Cloud Platform
2 SQL Server
3 Python
4 Airflow
5 Hadoop
6 BigQuery
7 Data lake
Pay: ₹200,000.00 - ₹2,800,000.00 per year
Work Location: Remote
