Must-Have Skills
Cloud & Data Engineering (AWS)
Strong hands-on experience with:
Experience designing cloud-native data lakes and data warehouses
Deep understanding of batch and streaming data pipelines
Experience building scalable and fault-tolerant data workflows
SQL & Python (Mandatory)
Strong expertise in SQL, including:
Experience working with large-scale datasets in Redshift/Athena
Strong Python programming skills for data engineering use cases
PySpark / Spark Processing
Data Processing & Engineering
Experience with distributed processing frameworks (Spark/PySpark)
Handling structured, semi-structured, and unstructured data
Expertise in:
Schema design
Partitioning
Query optimization
DevOps & Platform Engineering
Experience with Infrastructure as Code (Terraform / CloudFormation)
Hands-on experience in building CI/CD pipelines for data platforms
Exposure to containerization (Docker, ECS, EKS)
Collaboration & Ownership
Good-to-Have Skills
Experience with streaming technologies (Kinesis, Kafka, MSK)
Exposure to Lakehouse architectures and modern data platforms
Integration with BI and analytics tools
Knowledge of:
Data governance
Data quality frameworks
Metadata management
Familiarity with FinOps (cost optimization on AWS)
Exposure to Marketing/Customer Data Platforms (CDP / MarTech)
Experience working in Agile delivery models with global teams
Education Qualification
Certifications
(Any two preferred)
