Job Title: Senior Data Scientist
Experience: 5–7 Years
Location: Bangalore
Employment Type: Full-time
Job Description:
We are hiring an experienced Senior Python / PySpark Data Engineer (5–7 Years) for a Risk Reporting Migration Project involving the migration of an existing on-premise Python-based Machine Learning model to PySpark on Azure Databricks. The project focuses on processing data from multiple sources and generating environmental risk scores for insurance company products and operations.
Key Responsibilities:
- Migrate and re-engineer existing Python ML workflows into PySpark on Azure Databricks
- Design, develop, and optimize ETL pipelines for large-scale data processing
- Integrate and manage data from multiple sources efficiently
- Re-implement, optimize, and maintain Machine Learning models
- Build scalable and high-performance cloud-based solutions on Azure
- Develop and optimize SQL queries for data extraction and transformation
- Ensure performance tuning, reliability, and scalability of data pipelines
- Collaborate with cross-functional teams for migration and deployment activities
Required Skills:
✔ Strong experience in Python
✔ Hands-on expertise in PySpark / Apache Spark
✔ Experience with Azure Databricks
✔ Strong SQL knowledge
✔ Expertise in Data Engineering concepts
✔ Experience in Machine Learning models and workflows
✔ Knowledge of Azure Cloud Services
✔ Experience building and maintaining ETL Pipelines
✔ Experience handling large datasets and distributed data processing
✔ Understanding of cloud migration projects
Preferred Qualifications:
- Experience in Insurance, Risk Analytics, or Financial Services projects is a plus
- Familiarity with Data Lake, Delta Lake, and Azure ecosystem
- Strong problem-solving and performance optimization skills
Interested candidates can share their updated resume to: [Email ID]
Pay: ₹900,000.00 - ₹1,080,000.00 per year
Work Location: In person