Job Description
Seeking an experienced ETL Developer (4+ years in ETL development & AWS/PySpark) with strong expertise in PySpark, Python (NumPy, Pandas), and deploying AWS data solutions (S3, Lambda, SNS, Step Functions). Experience with large-scale data transformations, Delta Lake, cost optimization, data integration, and MWAA (Airflow) is highly desirable. Strong communication is essential for resolving delivery issues with IT and business stakeholders.
Require Skills
1.Experience deploying and running AWS-based data solutions using services or products such as S3, Lambda, SNS, Cloud Step Functions.
2.Person should be strong in Pyspark
3.Hands on and working knowledge in Python packages like NumPy, Pandas, Etc
4.Experience deploying and running AWS-based data solutions using services or products such as S3, Lambda, SNS, Cloud Step Functions. Sound knowledge in AWS services is must.
5.Person should work as Individual contributor
6.Good to have familiar with metadata management, data lineage, and principles of data governance.
Good to have:
1.Experience to process large set of data transformations both semi and structured data
2.Experience to build data lake & configuration on delta tables.
3.Good experience with computing & cost optimization.
4.Understanding the environment and use case and ready to build holistic Data Integration frame works.
5.Good experience in MWAA (airflow orchestration)
Soft skill:
1.Having good communication to interact with IT-Stake holders and Business.
2.Understand the pain point to delivery.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.
