Project Role : Data Platform Engineer
Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
Must have skills : AWS Glue
Good to have skills : NA
Minimum
5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and data models, while also engaging in discussions to refine and enhance the overall data architecture. You will be involved in various stages of the data platform lifecycle, ensuring that all components work seamlessly together to support the organization's data needs and objectives.
Roles & Responsibilities:
1. Minimum 6 years of experience with AWS technologies as ETL developer.
2. Ability to develop end to end pipelines using AWS Glue, Lambda
3. Minimum 4 years of experience with Pyspark.
4. Ability to write Python/Pyspark script without AWS console access
5. Working experience with SQL, Should have knowledge and experience on AWS Redshift, Aurora
6. Ability to design and implement cloud infrastructure for data processing and analytics at scale
7. Understanding of cloud services best practices and compliance requirements.
8. Proficiency in data code migration using Gitlab pipelines, Hands on knowledge/ work experience with CI/CD tools
9. Knowledge in deploying the code on AWS cloud using CFT templates.
10. Ability to adapt evolving business and technology requirements
11. Good analytical and problem-solving skills
12. Good to have knowledge on AWS Quick sight
13. Should have at least 1 support (AMS) project experience.
Professional & Technical Skills:
- Must Have Skills: Proficiency in AWS Glue.
- Good To Have Skills: Experience with data warehousing solutions.
- Familiarity with ETL processes and data pipeline development.
- Understanding of cloud computing concepts and services.
- Experience with data modeling and database design.
Additional Information:
- The candidate should have minimum 5 years of experience in AWS Glue.
- This position is based at our Bengaluru office.
- A 15-year full time education is required.
