Role description
Job Description: Azure PySpark Solution Architect
Job Summary:
We are seeking a highly skilled Azure PySpark Solution Architect to design and implement scalable data solutions on Microsoft Azure. The ideal candidate will have strong expertise in Azure services, PySpark, and solution architecture, ensuring efficient data processing and analytics workflows for enterprise applications.
Key Responsibilities:
Design and implement end-to-end data solutions using Azure Data Services and PySpark.
Develop high-performance ETL pipelines leveraging Azure Databricks, Azure Data Factory, and Synapse Analytics.
Architect scalable, secure, and cost-efficient cloud solutions that align with business objectives.
Collaborate with data engineers, data scientists, and business stakeholders to define technical requirements and solution roadmaps.
Optimize big data processing and ensure data governance, security, and compliance standards are met.
Provide technical leadership and best practices for Azure and PySpark-based data solutions.
Conduct performance tuning and troubleshooting for PySpark workloads.
Ensure seamless integration with third-party tools, APIs, and enterprise systems.
Mandatory Skills & Qualifications:
Expertise in Azure Cloud Services (Azure Databricks, Data Factory, Synapse, Azure Storage, ADLS).
Strong hands-on experience with PySpark for data processing and transformation.
Deep understanding of solution architecture, including microservices, event-driven architectures, and cloud-native patterns.
Experience with SQL, NoSQL databases, and data modeling in Azure.
Knowledge of CI/CD pipelines, DevOps, and Infrastructure-as-Code (Terraform, ARM templates, or Bicep).
Strong problem-solving skills and ability to optimize large-scale data workloads.
Excellent communication and stakeholder management skills.
Preferred Skills:
Familiarity with streaming technologies (Kafka, Event Hubs, Spark Streaming).
its azure
Skills
data architecture,azure databricks,sql,azure,ci/cd pipelines,pyspark,solution architecture,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.
