Role description
A strong Python and AWS Cloud Engineer with deep experience in REST API development, Databricks, and cloud-native integrations with 5-7 years. The role involves building and supporting a new HONI connector enabling Databricks to HBase integration, with a strong focus on observability, scalability, and multi-tenant architectures.
Key Responsibilities:
Design, develop, and maintain scalable backend services using Python.
Build and expose RESTful APIs for data integration and platform services.
Develop and manage data pipelines and workloads using Databricks.
Implement and support the HONI connector for Databricks-to-HBase integration.
Design and manage multi-tenant configurations ensuring data isolation and performance.
Implement observability solutions including dashboards, metrics, logging, and s.
Monitor system health and proactively address performance, reliability, and availability issues.
Collaborate with cross-functional teams including data engineering, platform, and cloud operations.
Ensure best practices in security, performance, and cost optimization on AWS.
Required Skills & Experience:
Strong hands-on experience with Python for backend and data engineering use cases.
Solid experience with AWS Cloud services (such as EC2, S3, IAM, Lambda, CloudWatch, etc.).
Proven experience in building and consuming REST APIs.
Strong hands-on experience with Databricks (Spark, notebooks, jobs, clusters).
Experience with system integration, especially between big data platforms (e.g., Databricks, HBase).
Strong experience in observability: monitoring, dashboards, s, and logging.
Experience designing and supporting multi-tenant architectures.
Good understanding of distributed systems and data processing frameworks.
Skills
python,databricks,aws backend,rest api,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.
