Overview:
We are looking for a Senior Data & AI Developer to lead the design and implementation of a GCP-based data and AI platform. This role will drive architecture decisions, build scalable pipelines, and implement AI-driven monitoring and data quality solutions.
Responsibilities:
Key Responsibilities
-
Architect and implement end-to-end data pipelines
-
Design and maintain a medallion data architecture (Bronze, Silver, Gold)
-
Lead development of data transformations using dbt
-
Build scalable ELT pipelines using SQL and Python
-
Design and operate Lakehouse architecture using open table formats (Apache Iceberg, Delta Lake, or Hudi)
-
Architect and maintain batch and streaming data pipelines
-
Apply cost-aware data modeling and query optimization
-
Implement AI/ML solutions for pipeline monitoring and data quality
-
Implement AI/ML and GenAI use cases for predictive analytics
-
Optimize reporting datasets for BI and analytics consumption
-
Design metadata management and data cataloging solutions
-
Define standards for data modeling, documentation, and governance
-
Build and maintain CI/CD pipelines for data workloads
-
Mentor junior engineers and set engineering best practices
Qualifications:
Required Qualifications
-
6–10+ years of experience in data engineering, analytics, or AI
-
Strong expertise in Google Cloud Platform / AWS (BigQuery, GCS, Composer, etc.)
-
Advanced SQL and Python skills
-
Advanced experience using dbt for analytics engineering
-
Strong background in data modeling and semantic layer design
-
Experience supporting BI tools and executive reporting
-
Experience designing data lakes and data warehouses
-
Strong understanding of ELT, orchestration, and data integration
-
Experience with CI/CD and DevOps practices for data platforms
-
Experience with surfacing data sets to Agents
-
Experience with API-based data ingestion and data surfacing
Nice to Have
-
Hands-on experience with LLMs and GenAI platforms
-
Background in enterprise-scale analytics platforms
-
Prior experience leading cloud data modernization programs
