- Key Responsibilities
- Lead the design and implementation of big data solutions using Spark Pyspark Hive and Scala
- Collaborate with cross functional teams to develop scalable data architectures and pipelines
- Optimize data processing workflows to ensure high performance and reliability
- Mentor and guide junior engineers fostering a culture of continuous learning and improvement
- Ensure data security and compliance with industry standards
- Minimum Qualifications
- Bachelor s degree in Technology B
- Tech or related field
- Proven experience in big data technologies such as Spark Pyspark Hive and Scala
- Strong analytical and problem solving skills
- Preferred Qualifications
- Experience with Kafka for real time data processing
- Demonstrated leadership skills in managing technology projects
- Ability to work effectively in a collaborative team environment
- Track record of delivering high quality data solutions
- Good to have skills
- Flask Pandas Data Analysis Springboot Microservices
- Knowledge of more than one technology
- Basics of Architecture and Design fundamentals
- Knowledge of Testing tools
- Knowledge of agile methodologies
- Understanding of Project life cycle activities on development and maintenance projects
- Understanding of one or more Estimation methodologies Knowledge of Quality processes
- Basics of business domain to understand the business requirements
- Analytical abilities Strong Technical Skills Good communication skills
- Good understanding of the technology and domain
- Ability to demonstrate a sound understanding of software quality assurance principles SOLID design principles and modelling methods
- Awareness of latest technologies and trends
- Excellent problem solving analytical and debugging skills
Technology->Big Data - Data Processing->Spark,Technology->Big Data - Data Processing->PySpark,Technology->Functional Programming->Scala
