We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in Python and SQL, along with experience in data workflow orchestration, backend services, and modern DevOps practices.
KEY RESPONSIBILITIES:
- Design, develop, and optimize scalable data pipelines using Python and SQL
- Build and manage ETL/ELT workflows for data ingestion, transformation, and processing
- Work with Apache Airflow for workflow orchestration and scheduling
- Integrate and process real-time data streams using tools like Kafka (good to have)
- Develop and maintain REST APIs using FastAPI for data services
- Containerize applications using Docker for consistent deployment
- Implement and manage CI/CD pipelines for automated testing and deployment
- Collaborate with data analysts, scientists, and backend teams to deliver reliable data solutions
- Ensure data quality, integrity, and security across systems
- Troubleshoot and optimize performance of data systems
REQUIRED SKILLS:
- Strong proficiency in Python and SQL
- Hands-on experience with Git for version control
- Strong working knowledge of Linux/Unix environments
- Understanding of data structures, databases, and data modeling
PREFERRED SKILLS:
- Minimum 1 year of experience.
- Familiarity with Kafka or other streaming platforms
- Knowledge of FastAPI or similar backend frameworks
- Exposure to CI/CD pipelines (Jenkins, GitHub Actions, etc.)
- Basic proficiency in MS Office tools
- Experience with cloud platforms
- Understanding of big data tools (Spark, Hadoop, etc.)
WHAT WE OFFER:
- Competitive salary and benefits
- Opportunity to work on scalable and impactful data systems
- Collaborative and growth-oriented work environment.
Pay: From ₹30,000.00 per month
Benefits:
- Paid sick time
- Paid time off
Work Location: In person