Data Engineer (Grade F) – GCP, Payments Domain
As a Lead Data Engineer, you will lead a high-performing team to architect and implement advanced data solutions for the payment’s domain. You will be responsible for SOI (BigQuery) and SOE (Spanner) systems and work on high-volume, low-latency systems that process payment events in real-time.
• Leadership & Team Management: Lead a cross-functional team of data engineers, guide career development, manage hiring and performance, and foster an Agile culture
• Architectural Design: Define and implement scalable, high-performance architectures for SOI and SOE using BigQuery, Spanner, Kafka, Flink, and Dataflow
• Data Modelling: Design complex, scalable data models for SOE systems, with a focus on high-volume, real-time payment data processing
• Real-Time Streaming: Lead the development of event-driven architectures with Kafka and Flink for real-time data transformation
• ISO 20022 Standards: Develop solutions based on financial data standards like ISO 20022, handling various payment formats (e.g., BACS, CHAPS)
• Legacy System Migration: Oversee the migration of legacy data from on-premises systems to GCP, ensuring smooth transitions and minimal downtime
• Optimization & Monitoring: Continuously monitor and optimize pipelines for performance, cost-efficiency, and low-latency processing
• Strategic Collaboration: Work with business stakeholders, architects, and product managers to define the roadmap and ensure the alignment of technical solutions with business needs
• CI/CD & Automation: Oversee the implementation of CI/CD processes and ensure seamless integration of code through Jenkins, Harness, and Terraform
