Hybrid / On-Prem Data Engineering Platform Engineer
-
Build and operate hybrid and on-prem data platforms supporting batch and streaming workloads
-
Design scalable storage, compute, and networking layers for data pipelines
-
Integrate on-prem platforms with public cloud services where required
-
Enable secure multi-tenant data access, governance, and lifecycle management
-
Automate platform provisioning and operations using Infrastructure as Code
-
Security Engineering
Required Skills & Experience
8+ years of experience in infrastructure, platform, or systems engineering
-
Experience designing hybrid or on-prem data engineering platforms, Microservices architecture
-
Strong understanding of Linux internals, K8 networking, and storage systems like CEPH
-
Experience with Kubernetes and containerized workloads
-
Proficiency in automation and scripting (Python, Bash, Go, or similar)
-
Experience building automation or autonomous systems that interact with real infrastructure
Preferred Skills
-
Exposure to data platforms such as Spark, Kafka, Flink, or similar
-
Experience with distributed storage systems (Ceph, object storage, etc.)
-
Familiarity with observability stacks (Prometheus, Thanos, Grafana, OpenTelemetry)
-
Experience in Go or Python and building Microservices for Multitenant systems
-
Understanding of AI safety, guardrails, and human-in-the-loop designs