Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Data Engineering
Good to have skills : Microsoft Azure Databricks, Scala, PySpark
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Key responsibilities
Design, implement, deploy, and maintain data marts, ETL (extract, transform, load) processes and systems. A.k.a. as our assets.
Ensure the reliability, scalability, and performance of our data assets.
Design and maintain quality indicators as well as the corresponding monitoring and alerting means.
Troubleshoot and document issues respecting Amadeus standards.
Continuous improvement mindset applied to data related issues, systems, and processes.
Technical and expertise awareness to keep up with industry standards, security recommendations and best practices within Offer organization.
About the ideal candidate:
Hands-on experience writing Production quality code in Scala (preferred) or PySpark or Java.
Hands-on experience on big data technologies, including the mapr filesystem, Apache Spark, Hadoop, Kafka & Impala.
Proven experience with the Apache Spark Architecture and components.
Hands-on experience on scripting languages including Bash scripting and Python.
Knowing different kinds of database technologies, including of course SQL.
Previous work with no-SQL databases, like MongoDB will be a plus.
Solid knowledge of build tools and in particular Maven and SBT.
Experience on building and maintaining DevOps pipelines will be a plus.
Familiarity with analytics platforms like Tableau will be a plus.
Cloud:
Familiarity with Azure cloud technologies.
Familiarity with Azure Databricks and Databricks SQL.
Familiarity with Snowflake Data Cloud will be a plus.
Qualifications
Education: University degree in computer science or related field or relevant experience
Proven track record of experience working in data engineering domain.
Strong experience defining ETL processes.
Experience with data modeling and data visualization concepts and tools.
Knowledge of Software Design under Agile frameworks (Scrum, Kanban, SAFe, ).
Proven experience on design and maintaining applications using Scala, (Py)Spark, MAPR distribution, Hadoop ecosystem, Kafka, Impala.
Hands-on experience on Microsoft Azure, Databricks.
Other:
Good English verbal and written communication skills
Strong team player with collaborative mindset
Excellent problem-solving and analytical skills.
Fast, thorough, and autonomous learner who also understands prioritization
Innovative thinker
Ability to maintain a proactive and positive attitude in a fast paced, changing environment
Thrives in a multi-cultural, global organization
Open-minded, should be able to adapt to working in a multi-cultural team atmosphere
Flexible to adapt to changing project needs driven by the customers
Ability to think out of the box, develop tools to enhance productivity
15 years full time education
