Role description
- Design, develop, and maintain big data pipelines and ETL workflows.
- Build scalable data processing systems using technologies such as Apache Hadoop and Apache Spark.
- Manage data ingestion from multiple sources, including databases, APIs, and streaming platforms.
- Optimize data storage and retrieval performance.
- Implement data quality, security, and governance standards.
- Work with cloud-based data platforms and services.
- Monitor and troubleshoot data processing jobs and infrastructure.
- Collaborate with data scientists and business teams to support analytics and machine learning initiatives.
- Document data architecture, workflows, and technical processes.
- Knowledge of SQL and NoSQL databases.
-
- Understanding of data modeling, data warehousing, and ETL concepts.
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes.
Skills
big data,apache spark,scala,sql,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.