Job Description: We are looking for PySpark developer with below skills: - Experienced in design and maintain data pipelines using AWS services. - Implemented data processing frameworks using Python and PySpark/Spark. - Developed and maintained APIs for data access and manipulation. - Monitor and manage data workflows. - Experience with data engineering with cloud service knowledge. - proficient in AWS Glue, Lambda and other AWS services. - Strong programming skill in Python, PySpark and SQL. - Hands-on experience with CI/CD tools such as Jenkins and GitHub. - Solid understanding of data storage solutions and management. - Excellent in problem-solving skills and able to work on open ended problems - Deliver with limited direction, usually within a complex environment, to drive rigorous, fact-based solutions and insights for clients - Articulate and document project requirements and client meetings. - Communicate project results in the client's business context - Provide technical guidance and mentorship to junior team members.
