Designation: Assistant Manager - Data Engineering
Experience: 7 to 10 Years
Location: Bengaluru
Job Description:
We are seeking a high-performing Assistant Manager - Data Engineering to take ownership of our scalable data pipelines and drive enterprise analytics initiatives.
Responsibilities:
Engineering Execution & Pipeline Mastery
High-Fidelity Pipeline Development: Lead the end-to-end engineering of incremental ETL/ELT pipelines. You will manage the ingestion of terabyte-scale financial data, ensuring low-latency delivery and 100% accuracy.
Medallion Layer Implementation: Be the primary owner of the Gold Layer. You will translate business logic into highly optimized Fact and Dimension tables, ensuring they are structured for maximum query efficiency in Big Query.
Infrastructure Scoping & Design: Partner with Architects and Product Managers to decompose complex business requirements into technical specs. You define the "how" for your engineering pod.
Migration Management: Drive the tactical execution of migrating legacy architectures to modern, automated frameworks. You will replace fragile, manual processes with robust, code-driven workflows.
Quality, Reliability & Mentorship
CI/CD & Data Ops: Champion a "Shift Left" approach to data quality. You will implement automated unit/integration tests and CI/CD pipelines to ensure that no "bad data" ever reaches production.
Performance Engineering: Act as the final word on Big Query performance tuning. You will oversee partitioning, clustering, and SQL optimization to ensure our compute costs stay low and our dashboards stay fast.
Technical Mentorship: Lead by example. You will conduct rigorous code reviews, mentor junior engineers, and foster a culture of engineering excellence within your team.
Skills:
SQL & Python, Pipeline Orchestration (Airflow/Composer), Dataflow (Apache Beam), Data proc (Spark), Incremental Loading Patterns
Star Schema, Snowflake Schema, and Medallion Architecture (Bronze/Silver/Gold)
