Roles & Responsibilities:
- Experience in understanding and translating data, analytic requirements and functional needs into technical requirements while working with global customers
- Build and maintain data pipelines to support large scale data management in alignment with data strategy and data processing standards
- Experience in Database programming using multiple flavor of SQL
- Deploy scalable data pipelines for analytical needs
- Experience in Big Data ecosystem – on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
- Worked on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL.
- Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines
- Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow
- Understand and execute IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
- Hands-on experience in using Spark Streaming, Kafka and Hbase
- Experience in any orchestration tool such as Airflow/Oozie
- Experience working in an Agile/Scrum development process
Academic Credentials : BE/BS/MTech/MS in computer science or equivalent work experience.
Experience : Associate-DE(2-4 YEARS ), Senior Associate-DE(4-6 YEARS ), TC-DE (6-8 YEARS )
Key Skills : Bigdata, Cloud, Python, SQL
Contact : CHAITHRA
Contact Number: 6362229035
Email ID: [email protected]
