India Python fastapi pyspark aws Jobs – 78 Open Jobs Today

Senior Data Engineer I - QuantumBlack, AI by McKinsey
McKinsey & Company —Bengaluru, Karnataka
- Azure
- Oracle
- Computer Science
Senior Data Engineer
Mastercard —Navi Mumbai, Maharashtra
- Full-time
- Master's degree
- Databases
- AWS
13d
Data Platform Engineering Lead - AITDS
Cognizant —Hyderabad, Telangana
- Full-time
- Hybrid work
- Azure
- System design
- Master's degree
Senior / Lead Data Scientist
INTERRA INFORMATION TECHNOLOGIES INDIA PRIVATE LIMITED —Noida, Uttar Pradesh
- Azure
- Doctoral degree
- Computer Science
- Health insurance
Quick apply
Senior AI/ML Lead
Synsoft Global —Indore, Madhya Pradesh
- Full-time
- Azure
- Computer Science
- Master's degree
Data Scientist
Valtech Group —Bengaluru, Karnataka
- Full-time
- Azure
- SQL
- AWS
4d
Associate Practice Manager
Apps Associates —Hyderabad, Telangana
- Full-time
- PMP
- System design
- Java
Lead Engineer - Data & AI
Quest Global —Bengaluru, Karnataka
- Full-time
- Azure
- Computer Science
- Master's degree
Quick apply
Principal Data GENAI Platform Engineer - Senior Vice President
Citi —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- AWS
Quality Automation Engineer - Data (India)
Codvo.ai —Remote
- Remote
- Azure
- Computer Science
- Master's degree
Fullstack Data Engineer (India)
Codvo.ai —Remote
- Remote
- AWS
- Machine learning
- Product management
Integration Engineer
LakeFusion —Remote
- Full-time
- Remote
- Azure
- English
- SQL
1d
Digital R&D Integration Manager
Sanofi —Hyderabad, Telangana
- Hybrid work
- Azure
- Management
- Computer Science
Snowflake Data Architect (With AI experience)
3Pillar —Remote
- Full-time
- Remote
- Microsoft Access
- Azure
- Master's degree
Lead Data Engineer with AI experience
3Pillar —Remote
- Full-time
- Remote
- Azure
- Master's degree
- SQL
AI Soution Architect
Algoworks Solutions —India
- Full-time
- Remote
- Azure
- Computer Science
- System design
Python, REST API, AWS
CGI —Hyderabad, Telangana
- Full-time
- Computer Science
- DevOps
- Master's degree
Quick apply
3h

More jobs to discover

Find similar jobs that you might be interested in.

Senior Data Engineer (ETL)
Technology Next —Pune, Maharashtra
Partner with analytics, business, and engineering teams to deliver impactful data solutions. We're looking for a passionate and experienced *Senior Data…
₹80,000.00 - ₹18,70,927.45 a month
Quick apply
Senior Data Engineer - Gurugram
CLANX —Gurugram, Haryana
Own data ingestion from client systems into the data platform. Mechademy is an enterprise AI company building real-time monitoring, diagnostics, and predictive…
₹30,00,000 - ₹40,00,000 a year
7d

I want to receive the latest job alerts for python fastapi pyspark aws in india

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

python fastapi pyspark aws jobs near india

Lead Engineer jobs in Bengaluru, Karnataka

Integration Engineer jobs in Remote

R&D Engineer jobs in Hyderabad, Telangana

Automation Engineer jobs in Pune, Maharashtra

Data Scientist jobs in Bengaluru, Karnataka

Data Engineer jobs in Remote

Senior Vice President jobs in Chennai, Tamil Nadu

Cloud Architect jobs in Remote

Data Engineer jobs in Navi Mumbai, Maharashtra

Full Stack Developer jobs in Pune, Maharashtra

Data Engineer jobs in Bengaluru, Karnataka

Lead Engineer jobs in Pithampur, Madhya Pradesh

Mechanical Engineer jobs in Ghaziabad, Uttar Pradesh

Biomedical Engineer ,hospital jobs in Vadodara, Gujarat

Solidworks, Creo, Design Engineer jobs in Madurai, Tamil Nadu

Lead Engineer jobs in Pune, Maharashtra

Lead Engineer jobs in Remote

Electronics Engineer jobs in Surat, Gujarat

Integration Engineer jobs in Chennai, Tamil Nadu

Senior Civil Engineer jobs in Bengaluru, Karnataka

Senior Data Engineer I - QuantumBlack, AI by McKinsey

McKinsey & Company -
Bengaluru, Karnataka

Apply Now

Job details

Qualifications

BCS
CI/CD
Cloud infrastructure
Azure
Oracle
Node.js
Law
Computer Science
React
Kubernetes
Relational databases
Software deployment
DevOps
Spark
Microsoft SQL Server
Git
Information security
Master's degree
Databases
SQL
AWS
Docker
Bachelor's degree
Machine learning
PostgreSQL
Terraform
Continuous integration
GitHub
APIs
Agile
AI
TypeScript
GitLab
Python
MySQL
Analytics

Full job description

Job ID: 104404

Bengaluru

Gurugram

Do you want to do work that matters, alongside supportive leaders who will help you grow faster than you ever thought possible? Are you a creative problem-solver who is energized by challenges? You’ve come to the right place.

YOUR IMPACT

As a Senior Data Engineer at QuantumBlack, AI by McKinsey, you will collaborate with business stakeholders, data scientists, and engineering teams to develop, productionize, and scale advanced data, machine learning, and Generative AI solutions that deliver measurable impact for our clients.

You will work across the full analytics and AI lifecycle — from understanding client data landscapes and building robust, reusable data pipelines, to enabling production-grade ML, LLM, and GenAI systems through strong MLOps, LLMOps, and DevOps practices.

Key responsibilities include building and maintaining technical platforms for advanced analytics and AI, designing scalable and reproducible data and ML pipelines, enabling CI/CD for data, ML, and GenAI workflows, and ensuring information security and compliance across cloud environments.

As a Senior Data Engineer you will collaborate with business stakeholders, data scientists, and internal teams to build and implement domain-focused, reusable data products and analytics platforms. You will design, build, and maintain robust, modular, scalable, and reproducible data pipelines supporting advanced analytics, machine learning, and GenAI use cases. You will understand client data landscapes, assess data quality, and work across structured, semi-structured, and unstructured data. You will map data fields to hypotheses and curate, wrangle, and prepare data for analytics, ML, and GenAI models. You will help build and maintain technical platforms that support end-to-end data and analytics engagements.

You will develop and deploy technology that enables productionization and deployment of ML and Generative AI solutions following industry best practices. You will establish and promote standards for software engineering, MLOps, LLMOps, and DevOps within multidisciplinary delivery teams.

You will design, build, and maintain modern, scalable, and secure CI/CD pipelines that automate development, testing, evaluation, and deployment of data pipelines, ML pipelines, and GenAI applications (including model, prompt, and inference workflows).

You will build and manage cloud-native infrastructure to support ML and GenAI lifecycle management, including experimentation, model tracking, deployment, monitoring, and governance. You will shape and support next-generation technology platforms that enable scaling of ML and GenAI products across teams and clients.

You will contribute to R&D projects and internal assetization efforts (e.g., GEMx / PMPx), building reusable frameworks, libraries, and platforms. You will participate in cross-functional problem-solving sessions with internal teams and clients, from data owners to senior leadership, to address business needs and deliver impactful solutions. You will guide global companies through data, ML, and AI solutions to transform their businesses and enhance performance across industries.

You will be based in Gurugram or Bengaluru as part of a global data engineering community, working in Agile, cross-functional teams alongside project managers, data scientists, machine learning engineers, software engineers, designers, and industry experts.

While we advocate for using the right tech for the right task, we often leverage the following technologies - Cloud & Data Platforms: AWS, GCP, Azure, Databricks; Languages & Frameworks: Python, PySpark, SQL, NodeJS, React, TypeScript, FastAPI, NestJS, Data, ML & GenAI: Spark, Kedro, MLflow, LangChain Vector; Databases & Search: Pinecone, Weaviate, Milvus, FAISS, PGVector, OpenSearch, Elasticsearc; Workflow & Orchestration: Airflow, Argo, Kedro, Temporal, n8n, Dify; Containerization & Infrastructure: Docker, Kubernetes, Terraform CI/CD & DevOps: GitHub Actions, Azure DevOps, GitLab, CircleCI; Observability: Grafana, Prometheus, OpenTelemetry, MLflow, Langfuse; Agentic AI: LangGraph, CrewAI, AutoGen.

YOUR GROWTH

Driving lasting impact and building long-term capabilities with our clients is not easy work. You are the kind of person who thrives in a high performance/high reward culture - doing hard things, picking yourself up when you stumble, and having the resilience to try another way forward.

In return for your drive, determination, and curiosity, we'll provide the resources, mentorship, and opportunities you need to become a stronger leader faster than you ever thought possible. Your colleagues—at all levels—will invest deeply in your development, just as much as they invest in delivering exceptional results for clients. Every day, you'll receive apprenticeship, coaching, and exposure that will accelerate your growth in ways you won’t find anywhere else.

When you join us, you will have:

Continuous learning: Our learning and apprenticeship culture, backed by structured programs, is all about helping you grow while creating an environment where feedback is clear, actionable, and focused on your development. The real magic happens when you take the input from others to heart and embrace the fast-paced learning experience, owning your journey.
A voice that matters: From day one, we value your ideas and contributions. You’ll make a tangible impact by offering innovative ideas and practical solutions, all while upholding our unwavering commitment to ethics and integrity. We not only encourage diverse perspectives, but they are critical in driving us toward the best possible outcomes.
Global community: With colleagues across 65+ countries and over 100 different nationalities, our firm’s diversity fuels creativity and helps us come up with the best solutions for our clients. Plus, you’ll have the opportunity to learn from exceptional colleagues with diverse backgrounds and experiences.
World-class benefits: On top of a competitive salary (based on your location, experience, and skills), we provide a comprehensive benefits package to enable holistic well-being for you and your family.

YOUR QUALIFICATIONS AND SKILLS

Bachelor’s degree in Computer Science, Engineering, IT, or a related field

4+ years of relevant experience across data engineering, MLOps, cloud, or DevOps roles

Strong hands-on experience with Python and distributed data processing frameworks (e.g., Spark)

Proven experience designing and maintaining production-grade data pipelines and analytics platforms

Hands-on experience working with data teams to productionize ML and GenAI workflows

Strong expertise in at least one major cloud platform (AWS, Azure, or GCP), including security and service integration

Proven experience building end-to-end CI/CD pipelines for data, ML, and GenAI applications

Solid experience with Docker, Kubernetes, and workflow orchestration tools (e.g., Airflow, Argo, Kedro, Temporal)

Hands-on experience implementing MLOps practices such as experiment tracking, model deployment, and lifecycle management

Practical experience delivering and operating production systems, including APIs, cloud infrastructure, and observability solutions

Working knowledge of SQL and relational databases (PostgreSQL, MySQL, SQL Server, Oracle)

Experience with RAG pipelines, vector databases, embedding models, and LLM frameworks

Please review the additional requirements regarding essential job functions of McKinsey colleagues.

Our unwavering commitment to integrity drives everything we do, guiding us to always act in the best interests of our clients, our people, and the communities we serve.

Apply Now

Refine Your Search

python fastapi pyspark aws jobs in india

Senior Data Engineer I - QuantumBlack, AI by McKinsey

Senior Data Engineer

Data Platform Engineering Lead - AITDS

Senior / Lead Data Scientist

Senior AI/ML Lead

Data Scientist

Associate Practice Manager

Lead Engineer - Data & AI

Principal Data GENAI Platform Engineer - Senior Vice President

Quality Automation Engineer - Data (India)

Fullstack Data Engineer (India)

Integration Engineer

Digital R&D Integration Manager

Snowflake Data Architect (With AI experience)

Lead Data Engineer with AI experience

AI Soution Architect

Python, REST API, AWS

More jobs to discover

I want to receive the latest job alerts for python fastapi pyspark aws in india

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected