Technical Skills:
Experience: Minimum of 5 years of professional "hands-on-keyboard" coding experience in a collaborative, team-based environment.
Ability to trouble shoot (SQL) and basic scripting experience.
Languages: Professional proficiency in Python or Java.
Methodology: Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience.
Core Data Engineering Competencies: Candidates must demonstrate a sophisticated understanding of the following modeling concepts to ensure data correctness during reconciliation: a. Temporal Data Modeling: Managing state changes over time (e.g., SCD Type 2).
Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies.
Performance Optimization: Advanced knowledge of data partitioning and clustering. d. Architectural Theory: Balancing Normalization vs. Denormalization and the strategic use of Natural vs. Surrogate Keys