Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines.
- Build and optimize data architectures, data lakes, and warehousing solutions.
- Integrate data from multiple APIs, databases, and third-party systems.
- Ensure data quality, consistency, security, and reliability across systems.
- Develop automated workflows for data ingestion, transformation, and validation.
- Work with structured and unstructured datasets at scale.
- Optimize SQL queries and database performance.
- Collaborate with backend, analytics, and AI teams for data-driven solutions.
- Monitor pipelines and troubleshoot production issues.
- Implement logging, monitoring, and alerting mechanisms for data systems.
- Maintain proper technical documentation and workflow diagrams.
Required Skills & Qualifications
- 2+ years of experience as a Data Engineer or similar role.
- Strong proficiency in SQL and database design.
- Experience with relational and NoSQL databases such as:
- MySQL
- PostgreSQL
- MongoDB
- BigQuery / Redshift / Snowflake
- Hands-on experience with ETL tools and data pipeline development.
- Strong programming skills in at least one language:
- Python
- Node.js
- Java
- Experience with cloud platforms:
- AWS / GCP / Azure
- Familiarity with data orchestration tools:
- Airflow
- Prefect
- Dagster
- Understanding of APIs, webhooks, and real-time data processing.
- Experience with Git and CI/CD workflows.
- Knowledge of Docker and containerized deployments.
- Good understanding of data security and governance practices.
Preferred Qualifications
- Experience with Apache Spark, Kafka, or distributed processing systems.
- Exposure to AI/ML data pipelines.
- Knowledge of analytics and BI tools such as:
- Power BI
- Tableau
- Looker
- Experience working in startup or fast-paced product environments.
- Familiarity with microservices architecture.
What We Offer
- Opportunity to work on scalable and impactful data systems.
- Collaborative and growth-focused work environment.
- Exposure to AI, analytics, and cloud-native technologies.
- Flexible work culture and learning opportunities.
- Competitive salary and performance-based growth.
Share your resume at [email protected]
Pay: ₹30,000.00 - ₹50,000.00 per month
Work Location: Hybrid remote in Indore, Madhya Pradesh (Indore)
