Required Skills & Qualifications:
- Strong proficiency in Python, LLMs, Lang Chain, Prompt Engineering, and related GenAI technologies.
- Proficiency with Azure Databricks.
- Strong analytical, problem-solving, and stakeholder communication skills.
- Solid understanding of data governance frameworks, compliance, and internal controls.
- Experience in data quality rule development, profiling, and implementation.
- Experience with Azure Data Services (Data Lake, Synapse, Blob Storage).
Preferred Qualifications:
- Experience supporting AI/ML pipelines, preferably GenAI or LLM based models
- Proficient in Python, PySpark, SQL, and Delta Lake architecture
- Hands-on experience with Azure Data Lake, Azure Data Factory, and Azure Synapse Analytics
- Experience in data engineering, with strong expertise in Databricks.
