Why this job matters
Data is central to our business, and this role helps strengthen the engineering excellence behind our data products. As a Platform Engineer, you’ll contribute to building the judicious data platform for Networks using modern cloud technologies across Kubernetes On‑Prem, AWS, GCP, and Cloudera. You’ll join the Data & AI Enablement Team to create, build, and assist high‑quality engineering solutions sourced from extensive data across a multi‑cloud environment. Our team operates on agile values—transparency, transparency, and continuous improvement—fostering strong stakeholder relationships and providing opportunities to learn, innovate, and grow.
What you’ll be doing
Create, develop, and maintain end‑to‑end data pipelines using Ab Initio (GDE, PDL, Conduct>IT, Express>IT).
Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala).
Develop and orchestrate real-time/near‑real‑time data ingestion flows using Apache NiFi.
Optimize ETL/ELT pipelines for performance and efficiency.
Perform tuning and bottleneck analysis for Spark, NiFi, and Ab Initio.
Deliver demos and knowledge sharing to stakeholders.
Enhance automated testing and deployments through CI/CD.
Continuously learn through internal and external training.
Skills you’ll need to succeed
Experience building Big Data solutions using Hadoop, GCP, or AWS.
Strong skills in Scala, Java, Python, Spark, Terraform, Kafka, Kinesis, BigQuery, Dataflow, SQL.
Solid understanding of Infrastructure as Code.
Proficiency with Kubernetes and CI/CD practices.
Familiarity with Confluence, JIRA, and version control (Git/SVN).
Ability to convey technical concepts effectively.
Curiosity and enthusiasm for learning new technologies.
Experience we expect
Big Data solution development using technologies such as Scala, Java, Python, Spark, Terraform, Kafka, Kinesis (and Analytics), BigQuery, Dataflow, BigTable, SQL.
Strong Ab Initio expertise (GDE, PDL, Conduct>IT, Express>IT, EME), including parallel processing and component optimization.
Advanced proficiency in Apache Spark (PySpark/Scala, SQL, Streaming, tuning).
Hands‑on experience with Apache NiFi (flow create, tuning, error handling, security).
Practical knowledge of CI/CD strategies.
Experience with Atlassian tools and version control (Git/SVN).
Ability to present technical issues and solutions clearly.
Keen interest in exploring and applying new technologies.
