Project Role : Custom Software Engineer
Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.
Must have skills : Databricks Unity Catalog
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
7+ years of project hands on Azure Data Platform experience, specializing in:
Azure Databricks with Unity Catalog for scalable data engineering, governance, and secure data sharing
Azure Data Factory (ADF) for orchestrating complex ETL/ELT pipelines
Azure Data Lake Storage Gen2 for enterprise grade data lake architecture and ingestion workflows
Azure SQL Database for metadata drive framework (MDMF) database
Programming & Data Engineering Expertise
7+ years of experience in Python, SQL, and PySpark for building reusable, performant data pipelines
Strong knowledge of Delta Lake mechanics (transaction logs, deletion vectors, schema evolution, compaction)
Skilled in data modeling, partitioning, and optimization for large scale analytical workloads
Data Governance & Security
Experience with Unity Catalog for fine grained access control and lineage tracking
Exposure to Microsoft Purview for metadata management and compliance
Familiarity with Azure security best practices (RBAC, service principals, managed identities, secret scopes)
Visualization & Business Enablement
Nice to have experience with Power BI for building dashboards and enabling self service analytics
Operational Excellence
Strong background in Azure DevOps CI/CD for data pipelines
Skilled in monitoring, troubleshooting, and performance tuning across Databricks and ADF workflows
Proven ability to document solutions in stakeholder ready formats for onboarding and governance
Certifications:
DP-203, DP-700, AZ-900, DP-900, Databricks certified data engineer
15 years full time education
