noida uttar pradesh data warehouse engineer Jobs – 25 Open Jobs Today

Related jobs to explore

Based on your search for data warehouse engineer

Software Development Engineer, Relay Fleet Tech (TTS)
ADCI - Haryana —Gurugram, Haryana
If you are looking for an opportunity to solve deep technical problems and build innovative solutions in a fast paced environment working with smart, passionate…
Senior Data Engineer
SolveIT Consultant —Gurugram, Haryana
As a Lead, you will provide technical governance, mentor junior engineers, and ensure our data platform is scalable, secure, and optimized for real-time…
₹20,00,000 - ₹40,00,000 a year
Quick apply

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Lead Software Engineer- Pyspark,AWS

Location- Noida / Indore / Pune / Gurugram

Job Description

8-10 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive.
Good hands on experience of python, Bash Scripts.
Good understanding of SQL and data warehouse concepts
Strong analytical, problem-solving, data analysis and research skills
Demonstrable ability to think outside of the box and not be dependent on readily available tools
Excellent communication, presentation and interpersonal skills are a must

Cloud Skills:

Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. IAM, Glue, EMR, RedShift, S3, Kinesis)
Orchestration with Airflow and Any job scheduler experience
Experience in migrating workload from on-premise to cloud and cloud to cloud migrations

Roles & Responsibilities

Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.
Perform integration testing of different created pipeline in AWS env.
Provide estimates for development, testing & deployments on different env.
Participate in code peer reviews to ensure our applications comply with best practices.
Create cost effective AWS pipeline with required AWS services i.e S3,IAM, Glue, EMR, Redshift etc.

Mandatory Skills-Pyspark, AWS

Years Of Experience-8 to 10 Years

Education/Qualification

BE / B.Tech / MCA / M.Tech

Skills: Pyspark , AWS