Bangalore, Hyderabad, Pune, Chennai
contract
senior
We are looking for a skilled Senior Data Engineer with 6–9 years of experience to design and deliver scalable data pipelines, optimize data workflows, and support AI/ML initiatives across cloud platforms. The ideal candidate has strong programming expertise, hands-on cloud experience (Azure/GCP), and the ability to work effectively in collaborative, fast‑paced Agile environments.
Manage and track tasks using ServiceNow. Design and develop cloud-native data engineering solutions (Azure/GCP). Build robust data pipelines using Python, PySpark, SQL, and Linux scripting. Optimize queries and manage metadata, dependencies, and orchestration workflows. Implement CI/CD pipelines following DevOps best practices. Work with Kubernetes, containers, cloud storage, and cluster/workspace management. Collaborate using Git in multi-developer environments. Support automation, API/microservice development, and Agile delivery practices. Apply domain knowledge in Healthcare (preferred), Retail, or Insurance. Contribute to AI/ML workflows, including feature engineering and model deployment. Work with ML frameworks (TensorFlow, PyTorch, scikit‑learn, MLflow). Support Multi-Agent AI technologies: Pydantic AI, LangChain, LangGraph, MCP/Agent protocols.
5–9 years of hands-on experience in data engineering. Strong expertise in Python, PySpark, SQL. Practical experience with Azure/GCP (certification preferred). Strong foundation in data structures, optimization, and distributed systems. Excellent communication and collaboration skills.