Designation: Senior Analyst - Data Engineering
Experience: 3 to 5 years
Location: Chennai
Job Description:
We are seeking a skilled Data Engineer with 3-5 years of experience to join our Analytics & Data Products team. The ideal candidate brings deep expertise in Python, SQL, and distributed data processing, with a strong ability to translate complex business workflows into reliable, scalable data pipelines. In this role, you will leverage modern cloud ecosystems (AWS or Azure) and major data platforms (Databricks or Snowflake) to build out our core data infrastructure, ensuring our business has access to high-quality, actionable data products.
Responsibilities:
- Design, develop, and maintain highly scalable ETL/ELT pipelines using Python, SQL, and PySpark to process large volumes of structured, semi-structured, and unstructured data.
- Architect and implement robust data warehouse or lakehouse solutions leveraging Databricks or Snowflake, adhering to best-practice data layering techniques (e.g., Medallion Architecture: Bronze, Silver, Gold).
- Deploy and optimize data workloads on enterprise cloud infrastructure (AWS or Azure), ensuring high performance, security, and cost-efficiency.
- Design conceptual and logical data models, including complex Fact and Dimension tables, to support both downstream business intelligence reporting and advanced analytics.
- Collaborate with business stakeholders, data scientists, and analysts to map operational workflows, identify data pain points, and define requirements for new data products.
- Develop and automate data ingestion frameworks utilizing CI/CD pipelines to ensure seamless, version-controlled data flows across development, staging, and production environments.
- Implement comprehensive data governance and observability within the data platform, including Role-Based Access Control (RBAC), data masking, and automated data quality monitoring.
Skills:
- Very good experience in Python
- Proficient in SQL concepts
- Experience with AWS / Azure concepts
