Technology & Transformation - Engineering - Senior Consultant - AWS Data Engineer
- Job requisition ID : 106918
- Location: Hyderabad/Bengaluru
- Entity: Deloitte Touche Tohmatsu India LPP.
Job Title: Software Engineer – Data Engineering
Experience: 6+ Years
Open Positions: 15
Location: Bengaluru / Hyderabad
Work Model: Hybrid – Mandatory 3 days/week from client office
About the Role
We are looking for skilled Data Engineers to join a high visibility datastore migration program. The selected candidates will be part of the Datastore Migration Factory Team, responsible for end-to-end migration from on-prem Data Lake to AWS-hosted Lakehouse architecture.
This role involves pipeline migration, data transformation, reconciliation, and stakeholder engagement to ensure seamless migration and functional equivalence of production data assets.
Key Responsibilities
-
Migrate data pipelines from legacy/on-prem Data Lake environments to AWS-hosted Lakehouse
-
Refactor and migrate extraction logic, scheduling workflows, and ingestion frameworks
-
Build and optimize data ingestion pipelines
-
Convert and optimize legacy SQL/Spark-based consumption patterns for Snowflake and Iceberg
-
Ensure data integrity, reconciliation, and quality validation during migration
-
Work closely with internal stakeholders for data handoff, sign-off, and migration validation
-
Collaborate with platform and data management teams to adopt new workflows and technologies
-
Analyze usage patterns to deliver optimized and scalable data products
Must Have Skills
-
6+ years of strong hands-on development experience
-
Experience in AWS Cloud with on-prem to Lakehouse migration
-
Strong expertise in building ingestion pipelines
-
Strong proficiency in SQL and coding skills in Python
-
Strong understanding of:
-
SCDs (Slowly Changing Dimensions)
-
Milestoning / Temporal Data Modeling
-
Data Lineage
-
Data Lake concepts
-
Schema Evolution & Enforcement
-
Data Partitioning & Clustering
-
Experience with Spark
-
Familiarity with CI/CD practices and SDLC
-
Basic troubleshooting and scripting experience
Good to Have Skills
-
Experience with Kafka
-
Exposure to Hadoop (HDFS/Hive)
-
Knowledge of Sybase IQ
-
Experience with Kubernetes (K8s) deployments
-
Familiarity with data formats such as JSON, Avro, and Parquet
-
Hands-on experience with Snowflake and Apache Iceberg
-
Understanding of Normalization vs Denormalization, Natural vs Surrogate Keys
Educational Qualification
Bachelor’s or master’s degree in computer science, Engineering, Applied Mathematics, or a related quantitative field.
Key Competencies
-
Strong ownership and delivery mindset
-
Excellent stakeholder management and communication skills
-
Ability to work effectively with global teams across time zones
-
Strong problem-solving skills and learning agility
-
High integrity, collaboration, and professionalism
