Purpose of the job
The DataOps Engineer will play a critical role in ensuring the reliability, security and operational excellence of Collinson's modern data platform. As a key member of the Data & Analytics team, you will be responsible for automating platform operations, maintaining cloud infrastructure, supporting CI/CD pipelines and ensuring the platform remains secure, scalable and highly available.
In this hands-on role, you will work closely with Data Engineers, Security, Infrastructure and Product teams to support enterprise-wide data initiatives through automation, observability and platform standardisation.
Key Responsibilities
- Manage and maintain Snowflake, Kafka, AWS, MongoDB and supporting data platform infrastructure.
- Build and maintain CI/CD pipelines and deployment automation.
- Develop and maintain Infrastructure as Code using Terraform.
- Manage AWS networking including VPCs, VPC Peering, PrivateLink and secure private networking.
- Work with the Central Network team to implement and support enterprise networking solutions.
- Support Confluent Kafka platform operations and event-driven data integration patterns.
- Perform platform patching, upgrades, and lifecycle management.
- Ensure timely remediation of security vulnerabilities and compliance with security standards.
- Implement monitoring, alerting and observability using Datadog and platform monitoring tools.
- Support production incidents, root cause analysis, and operational improvements.
- Maintain platform documentation, operational runbooks, and engineering standards.
- Optimize platform performance, reliability, and cloud costs.
- Support platform governance, access management, and disaster recovery activities.
- Evaluate emerging technologies and recommend improvements to platform engineering practices.
- Own operational excellence of the data platform.
- Define and improve platform reliability standards.
- Drive automation and reduce manual operational effort.
- Improve developer experience for data engineering teams.
- Develop and maintain operational metrics, SLAs and SLOs to improve platform reliability and availability.
Knowledge, skills and experience required
Mandatory Technical Skills
DataOps & Platform Engineering
AWS Networking
Preferred Skills
AWS Transit Gateway
AWS Direct Connect / VPN concepts
Datadog dashboards and alerting
Airflow
Platform Engineering / SRE practices
Nice to Have
Generative AI fundamentals
LLM integration patterns
AI Agent frameworks
Machine Learning platform awareness
Real-time analytics architectures
Person Specification
- Self-motivator with a desire to learn new skills and embrace new technologies in a constantly changing technology landscape
- Strong problem-solving and analytical skills.
- Passion for automation, reliability and secure platform operations.
- Self-motivated with a continuous learning mindset.
- Strong stakeholder management and communication skills.
- Ability to communicate technical concepts to non-technical audiences.
- Collaborative team player who thrives in agile environments.
- Quality-focused with strong attention to detail.
- Ability to balance business priorities with technical excellence.
- Proactive in identifying opportunities for improvement and innovation.
- Comfortable working across global teams and multiple business domains.
