Job Overview
We are looking for an experienced Solution Architect – Data Engineering with 10+ years of experience in designing scalable data solutions and leading data engineering initiatives. The ideal candidate should have strong expertise in Solution Architecture, Data Warehouse, Data Lake, Azure Synapse, and PySpark.
Key Responsibilities
- Design and implement scalable data architecture and solution architecture.
- Define architecture for Data Warehouses and Data Lakes.
- Design and implement Medallion Architecture (Bronze, Silver, Gold layers).
- Lead data engineering and ETL/ELT development activities.
- Design and optimize data pipelines using Azure Synapse and other Azure data services.
- Develop and review data processing solutions using PySpark.
- Ensure data solutions are scalable, secure, reliable, and performance-optimized.
- Define and implement data validation and data quality processes.
- Work closely with data engineers, developers, business teams, and other stakeholders.
- Provide technical guidance and conduct architecture and code reviews.
- Identify technical challenges and recommend appropriate solutions.
Required Skills
- 10+ years of experience in Data Engineering / Solution Architecture.
- Strong expertise in Solution Architecture.
- Strong knowledge of Data Warehouse and Data Lake Architecture.
- Good understanding of Medallion Architecture.
- Strong hands-on experience in Data Engineering and ETL/ELT.
- Hands-on experience with Microsoft Azure, especially Azure Synapse Analytics.
- Strong knowledge of PySpark.
- Experience in Data Validation and Data Quality.
- Strong understanding of data pipelines, data modeling, and data integration.
- Good analytical and problem-solving skills.
Preferred Skills
- Experience with other Azure data services such as Azure Data Factory, Azure Data Lake Storage, and Azure Databricks.
- Knowledge of cloud-based data architecture and best practices.
- Experience leading technical teams and data architecture initiatives.
- Good communication and stakeholder management skills.
Pay: ₹887,870.36 - ₹3,000,000.00 per year
Application Question(s):
- Mention your last working date
Experience:
- Solution architecture: 9 years (Preferred)
- Data warehouse: 9 years (Preferred)
- Data Architect: 9 years (Preferred)
- PySpark: 9 years (Preferred)
- Azure Data Factory,: 9 years (Preferred)
Work Location: Hybrid remote in Chennai, Tamil Nadu (Chennai District)