Required Skills:
- Informatica PowerCenter
-
ETL Development
-
AWS Data Services
-
SQL
-
Apache Spark
-
Data Warehousing
Senior Data Engineer – Job Description Role Overview The Senior Data Engineer is responsible for designing, building, and optimizing data pipelines and models to enable efficient data availability and consumption across the platform and business applications. Experience & Education • 7–10 years of relevant experience in data engineering or similar roles • Ability to operate in fast-changing and highly analytical environments • Bachelor’s or Master’s degree in: Systems Engineering, Data Science, Business Analytics, Or equivalent Key Responsibilities Data Engineering & Pipeline Development • Build and maintain scalable data integration and transformation pipelines using AWS (Glue, Spark) • Develop and evolve ETL pipelines to create business-ready datasets • Analyse existing data models and implement performance optimizations • Improve data ingestion and consumption performance Data Platform & Application Support • Support consumer applications in accessing platform data • Ensure adherence to data standards, guidelines, and best practices • Monitor data pipelines and debug issues or failures Core Technical Skills 1. dbt Development (AWS Redshift) • Design, develop, and maintain dbt models on Amazon Redshift • Apply best practices including: o Modular and scalable model design o Testing and documentation o Data quality and freshness checks • Manage dbt project configurations and environments • Optimize performance and handle schema evolution • Ensure alignment with security and data governance standards 2. CI/CD & GitHub Enablement • Build and manage CI/CD pipelines using GitHub (GitHub Actions preferred) • Automate: dbt builds and tests, Code validation and quality checks, Environment promotions • Define: Branching strategies, Pull request processes, Release management practices • Ensure version control, auditability, and rollback capabilities 3. Data Integration & ETL • Strong experience with: Informatica PowerCenter, Informatica Cloud • Hands-on development of ETL/data transformation processes 4. Database & Data Management • Strong SQL and relational database expertise • Experience in: Data modelling, Data warehousing, Data management practices Preferred Skills • Experience with Big Data and Data Lakes (AWS preferred) • Knowledge of data warehouse and BI architecture • Experience with Tableau or similar BI tools • Familiarity with Databricks or other cloud platforms Tools & Technologies • ETL: Informatica PowerCenter / Informatica Cloud • Cloud: AWS (S3, Redshift, Glue, Spark) • Visualization: Tableau • Data Modelling & Transformation: dbt • DevOps: GitHub, CI/CD pipelines Additional Competencies • Strong analytical and problem-solving skills • Ability to identify patterns, trends, and insights from complex datasets • Understanding of: Quality processes, Customer Voice, IMS / QMS frameworks • Experience with workflow tools (Power Automate / Power Apps) is a plus Location & Work Model • Location: Bangalore, Karnataka, India • Work Model: Onsite
