A strong Python and AWS Cloud Engineer with deep experience in REST API development, Databricks, and cloud-native integrations with 4-6 years. The role involves building and supporting a new HONI connector enabling Databricks to HBase integration, with a strong focus on observability, scalability, and multi-tenant architectures.
Key Responsibilities:
Design, develop, and maintain scalable backend services using Python.
Build and expose RESTful APIs for data integration and platform services.
Develop and manage data pipelines and workloads using Databricks.
Implement and support the HONI connector for Databricks-to-HBase integration.
Design and manage multi-tenant configurations ensuring data isolation and performance.
Implement observability solutions including dashboards, metrics, logging, and s.
Monitor system health and proactively address performance, reliability, and availability issues.
Collaborate with cross-functional teams including data engineering, platform, and cloud operations.
Ensure best practices in security, performance, and cost optimization on AWS.
Required Skills & Experience:
Strong hands-on experience with Python for backend and data engineering use cases.
Solid experience with AWS Cloud services (such as EC2, S3, IAM, Lambda, CloudWatch, etc.).
Proven experience in building and consuming REST APIs.
Strong hands-on experience with Databricks (Spark, notebooks, jobs, clusters).
Experience with system integration, especially between big data platforms (e.g., Databricks, HBase).
Strong experience in observability: monitoring, dashboards, s, and logging.
Experience designing and supporting multi-tenant architectures.
Good understanding of distributed systems and data processing frameworks.
python,databricks,aws backend,rest api,
