Role description
UST is looking for a skilled AWS Data Engineer to join team with 5 to 10 years of experience and contribute to the development and maintenance of robust data pipelines and systems on the AWS platform, with a focus on leveraging PySpark for efficient data processing. As a Data Engineer, role will play a crucial role in ensuring the efficient flow, storage, and processing of data for our organization. Responsibilities: Data Pipeline Development: Design, implement, and maintain scalable and efficient data pipelines on the AWS platform using tools such as AWS Glue, Apache Spark, and PySpark. AWS Services Utilization: Leverage AWS services like S3, Glue, Athena, and others to build end-to-end data solutions. ETL Processing with PySpark: Develop and optimize ETL processes using PySpark to facilitate seamless data extraction, transformation, and loading. Requirements: Experience: Proven experience as a Data Engineer with a focus on AWS data solutions, including hands-on experience with PySpark. Programming Skills: Proficient in Python, with advanced experience in PySpark for efficient data processing. ETL Tools: Hands-on experience with AWS Glue or other ETL tools for data processing.
Skills
data engineering,data pipeline,data extraction,etl process,pyspark,amazon web services,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.