We are seeking an experienced AWS DevOps Engineer to support the development, automation, and maintenance of cloud-based data platforms. The ideal candidate will have strong expertise in AWS, Infrastructure as Code, CI/CD pipelines, data lake technologies, and Agile delivery practices. This role requires close collaboration with Data Engineers, Architects, Product Owners, and business stakeholders to deliver scalable and reliable data solutions.
-
Design, develop, and manage AWS infrastructure using Terraform and Infrastructure as Code (IaC) principles.
-
Build and maintain CI/CD pipelines using GitHub Actions to automate deployment and release processes.
-
Manage source code repositories, branching strategies, pull requests, and code reviews using Git and GitHub.
-
Develop and support data processing solutions using Python, PySpark, SQL, Apache Hudi, and Apache Iceberg.
-
Optimize and maintain cloud-based data lake and lakehouse platforms on AWS.
-
Create, publish, and maintain data products within the Collibra Data Marketplace.
-
Participate in Agile/SAFe ceremonies including sprint planning, PI planning, stand-ups, and retrospectives.
-
Track work items in Jira and maintain technical documentation in Confluence.
-
Ensure platform reliability, security, scalability, and operational excellence.
-
Strong hands-on experience with AWS cloud services.
-
Proficiency in Terraform for Infrastructure as Code (IaC).
-
Experience with Git and GitHub, including branch management and pull request workflows.
-
Strong experience with GitHub Actions and CI/CD pipeline development.
-
Proficiency in Python development, including PySpark-based data processing.
-
Strong SQL skills, preferably with Amazon Athena.
-
Experience with Apache Hudi and Apache Iceberg.
-
Understanding of Data Lake and Lakehouse architectures.
-
Experience working with Collibra Data Marketplace and data product management.
-
Experience working within a SAFe Agile framework.
-
Hands-on experience with Jira and Confluence.
-
Strong communication and stakeholder management skills.
-
AWS Certifications (AWS DevOps Engineer, Solutions Architect, or equivalent).
-
Experience in enterprise-scale cloud data platforms.
-
Knowledge of data governance and metadata management practices.
-
Experience with Data Mesh and Data Product concepts.
-
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
-
5–8 years of overall IT experience.
-
Minimum 3+ years of hands-on experience in AWS DevOps and cloud infrastructure automation.
-
Experience supporting modern data platforms and cloud-native solutions.
