Job Description: Technical Architect (DataBricks, BigData, Python & PySpark):
10+ years of experience in data engineering with strong proficiency in Python and PySpark.-
3–5+ years of hands-on experience with Databricks platform on Azure, AWS, or GCP.
-
Deep understanding of Apache Spark internals and distributed computing concepts.
-
Strong knowledge of Delta Lake, Lakehouse architecture, and data lake management.
-
Proven experience with large-scale Big Data platforms (Hadoop, Hive, HDFS, etc.).
-
Proficiency in SQL and working with relational and non-relational databases.
-
Solid understanding of CI/CD, version control (Git), and DevOps for data pipelines.
-
Experience with data orchestration tools (e.g., Airflow, Azure Data Factory).
-
Experience in data warehouse design and maintenance
-
Experience in agile development processes using Jira and Confluence.
-
Experience in cross-functional teams.
-
Understanding on the SDLC.
-
Understanding on the Agile methodologies.
-
Communication with customer and producing the Daily status report.
-
Should have good oral and written communication.
-
Should be a good team player.
-
Should be proactive and adaptive.
