Job Description – Senior Data Engineer (L3)
Company: Programming.com
Client: Confidential
Role: Senior Data Engineer (L3)
Experience: 8+ Years
Location: Hyderabad (Onsite)
Shift: Night Shift (7:30 PM IST)
Budget: Up to ₹30 LPA
Notice Period: Immediate Joiners Only
About the Role
We are looking for an experienced Senior Data Engineer (L3) to join our Data Science team and build scalable, production-grade data infrastructure that powers analytics, machine learning, and business intelligence. The ideal candidate should have strong expertise in DBT, Databricks, PySpark, SQL, Airflow, and modern data lakehouse architectures.
Key Responsibilities
- Design, develop, and maintain DBT models for trusted datasets, metrics, and feature engineering.
- Build and manage scalable data pipelines using Databricks, PySpark, and Delta/Iceberg tables.
- Transform raw operational data into reliable, production-ready datasets.
- Develop, schedule, and monitor workflows using Airflow and Prefect.
- Collaborate with Data Scientists and ML Engineers to build production-ready feature pipelines.
- Optimize Spark and DBT workloads for performance, scalability, and cost efficiency.
- Participate in code reviews and maintain high standards for data quality, testing, and documentation.
- Design reliable and fault-tolerant data engineering solutions.
- Work with Infrastructure-as-Code tools such as Terraform, AWS CDK, or Pulumi.
- Support AI/ML initiatives and contribute to AI-enabled data workflows.
Required Skills
- 8+ years of experience in Data Engineering.
- Strong SQL skills.
- Hands-on experience with DBT, Databricks, PySpark, and Airflow.
- Experience working with distributed data systems.
- Knowledge of Delta Lake or Apache Iceberg.
- Experience with Infrastructure-as-Code tools (Terraform, AWS CDK, or Pulumi).
- Understanding of data modeling, ETL/ELT pipelines, and workflow orchestration.
- Excellent written and verbal communication skills.
- Experience using AI coding assistants such as Cursor, GitHub Copilot, Claude Code, or similar.
Preferred Skills
- Experience with Kinesis or other streaming technologies.
- Exposure to MLOps and Machine Learning data pipelines.
- Experience supporting AI/ML teams.
- Familiarity with supply chain or logistics domain.
- Experience working with US-based engineering teams.
- Experience integrating LLMs or AI into data engineering workflows.
Technology Stack
- DBT
- Databricks
- PySpark
- SQL
- Airflow
- Prefect
- Delta Lake / Apache Iceberg
- Terraform / AWS CDK / Pulumi
- Kinesis (Preferred)
- EMR (Preferred)
- Sigma (Preferred)
Interested candidates who can join immediately are encouraged to apply.
Pay: ₹2,900,000.00 - ₹3,000,000.00 per year
Work Location: In person
