1.5+ years’ experience in Design and develop ETL integration patterns using Python on Spark..
2.Develop framework for converting existing PowerCenter mappings and to PySpark(Python and Spark) Jobs.
3.Create Pyspark frame to bring data from DB2 to Amazon S3
4 Have experience in processing structured/unstructured/semi-structured data using python. Ex. CSV, XML, HTML, SQL and JSON.
