Role description
Who we are:
At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at .
Summary:
UST is looking for a Senior Data Engineer with strong expertise in Spark, Streaming, and GCP to build and manage scalable real-time and batch data pipelines supporting analytics and ML use cases.
The Opportunity:
- Design, develop, and maintain ETL/ELT pipelines for batch and real-time data processing
- Build real-time streaming pipelines using Spark (PySpark/Scala), Kafka, Flink, or Pub/Sub
- Develop and optimize scalable data platforms including data lakes and data warehouses (BigQuery)
- Perform performance tuning of Spark jobs, SQL queries, and data workflows for efficiency and cost optimization
- Implement data quality checks, monitoring, and ing mechanisms
- Collaborate with analytics, ML, and business teams to deliver reliable data solutions
What you need:
- Strong experience in designing scalable data engineering solutions
- Hands-on expertise in batch and streaming data architectures
- Ability to optimize data pipelines for performance and reliability
- Experience working in cloud-based data ecosystems
Required Skills:
- Programming: Python, SQL, PySpark; Scala/Java preferred
- Big Data: Apache Spark (Spark SQL, DataFrames, Streaming)
- Streaming: Apache Kafka, Flink, or GCP Pub/Sub
- Cloud: GCP (BigQuery, GCS, Dataflow); Azure exposure is a plus
- Databases: Data Warehousing (BigQuery, Snowflake, Redshift), NoSQL
- Tools: Airflow, Databricks; Docker & Kubernetes are an advantage
Desired Skills:
- Experience supporting analytics and ML workloads
- Exposure to DevOps and cloud-native data engineering practices
Qualification:
- Bachelor’s degree in Engineering, Computer Science, or equivalent
What we believe:
We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.
Humility:
We will listen, learn, be empathetic and help selflessly in our interactions with everyone.
Humanity:
Through business, we will better the lives of those less fortunate than ourselves.
Integrity:
We honour our commitments and act with responsibility in all our relationships.
Equal Employment Opportunity Statement
UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.
All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.
- To support and promote the values of UST.
- Comply with all Company policies and procedures
Skills
scala,big data,pyspark,gcp data engineering,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.
