Chakan Pune Maharashtra Big data engineer Jobs – 14 Open Jobs Today

Data QA Engineer - Delivery Lead
Acuity Knowledge Partners —Kharadi, Pune, Maharashtra
- Azure
- Oracle
- Databases
11h
Data Scientist
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- Doctoral degree
- Computer Science
AI Engineer
Dentsu —Kharadi, Pune, Maharashtra
- Full-time
- Hybrid work
- Azure
- Master's degree
- SQL
1d
Lead AI Engineer
Dentsu —Baner, Pune, Maharashtra
- Full-time
- Hybrid work
- Azure
- Master's degree
- SQL
1d
Back-End Developer (Java, Golang, Ruby, Python)
Nitor Infotech —Pimpri-Chinchwad, Maharashtra
- Oracle
- Java
- Master's degree
Quick apply
Lead Architect- AI/ML
BirlaSoft —Hinjawadi, Pune, Maharashtra
- Azure
- Doctoral degree
- Computer Science
Development Engineer 4
Comcast Corporation —Pune District, Maharashtra
- Full-time
- Computer Science
- Java
- Master's degree
Senior DevOps Software Engineer
Nitor Infotech —Pimpri-Chinchwad, Maharashtra
- Azure
- Computer Science
- DevOps
Quick apply
Sr. Engineer - Inference Engine
Magna International —Pune District, Maharashtra
- Full-time
- Computer Science
- Master's degree
- C++
Quick apply
Senior Engineer - Global Test Automation Framework
Magna International —Pune District, Maharashtra
- Full-time
- Azure
- APIs
Quick apply
Sr. Engineer - Virtual ECU Development
Magna International —Pune District, Maharashtra
- Full-time
- Remote
- Computer Science
- Master's degree
- C++
Quick apply
Sr. Engineer - Elastic Search
Magna International —Pune District, Maharashtra
- Full-time
- APIs
Quick apply
Sr. Engineer - Machine Learning
Magna International —Pune District, Maharashtra
- Full-time
- Machine learning
Quick apply

Related jobs to explore

Based on your search for big data engineer

Software Engineer
Optum —Pune, Maharashtra
This position has an on-call rotation schedule that requires immediate off-hours response. Comply with the terms and conditions of the employment contract,…
8d
AI/ML Engineer
Optum —Pune, Maharashtra
Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to,…

I want to receive the latest job alerts for big data engineer in chakan pune maharashtra

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

big data engineer jobs near chakan pune maharashtra

Data Scientist jobs in Hinjawadi, Pune, Maharashtra

Power Electronics Engineer jobs in Bengaluru, Karnataka

Hardware Engineer jobs in Pune, Maharashtra

Fresher Civil Engineer jobs in Mumbai, Maharashtra

Senior Engineer jobs in Chennai, Tamil Nadu

Senior Engineer jobs in Hosur, Tamil Nadu

Senior Engineer jobs in Bengaluru, Karnataka

Lead Engineer jobs in Pune, Maharashtra

Aeronautical Engineer jobs in Bengaluru, Karnataka

Lead Engineer jobs in Remote

Electronics Communication Engineer jobs in Surat, Gujarat

Lead Engineer jobs in Karnataka

Fea Engineer jobs in Pune, Maharashtra

Civil Engineer For Contract Basis jobs in Maharashtra

Mechanical Engineer, Kesurdi, Shirwal jobs in Shirwal, Maharashtra

Technical Support Engineer Fresher jobs in Tamil Nadu

Instrumentation Engineer jobs in Pune, Maharashtra

Back Office , Bank, Data Entry Operator jobs in Jalgaon, Maharashtra

Data Scientist jobs in Tiruchchirappalli, Tamil Nadu

Data Entry, Typing jobs in Thiruvananthapuram, Kerala

Data QA Engineer - Delivery Lead

Acuity Knowledge Partners -
Kharadi, Pune, Maharashtra

Apply Now

Job details

Permanent
11 hours ago

Qualifications

Jira
CI/CD
Azure
Oracle
Cassandra
Kubernetes
Big data
Software deployment
Spark
Microsoft SQL Server
NoSQL
Git
MongoDB
Databases
SQL
AWS
Analysis skills
Quality assurance
PostgreSQL
Terraform
Continuous integration
GitHub
APIs
ETL
Agile
Kafka
Metadata
DynamoDB
AI
Jenkins
GitLab
Communication skills
Python
Control-M
Hadoop

Full job description

Job Description

Job purpose

Looking for a Data QA Engineer to lead data validation and regression testing across capital-markets data pipelines spanning legacy and modern platforms. The role will focus on ensuring data accuracy, completeness, consistency, integrity, and adherence to business rules through source-to-target validation, schema checks, reconciliation, lineage review, and automation-led regression testing.

The candidate will build reusable Python/SQL-based validation frameworks, support batch and cloud execution, validate post-trade data flows, identify data anomalies, and partner with engineering and business teams to embed strong data-quality controls. The ideal candidate combines data QA expertise, capital-markets domain understanding, automation-first thinking, and strong ownership of data quality across environments.

Key responsibilities

Perform source-to-target data validation across legacy and modern systems, including SQL Server and cloud-based data environments.

Validate data accuracy, completeness, consistency, timeliness, duplication handling, referential integrity, schema structures, metadata, lineage, and business-rule conformance.

Build and maintain automation-first regression testing frameworks using Python, PySpark, SQL, and validation utilities.

Execute field-level, dataset-level, transformation-level, and aggregate-level data checks across source, staging warehouse, data lake, and downstream systems.

Validate ETL/ELT pipelines, post-trade data flows, stored procedures, batch jobs, and cloud-based execution workflows.

Integrate regression tests, data validation checks, SQL deployables, and quality gates into CI/CD pipelines using DevOps, Jenkins, GitLab, or equivalent tools.

Design reusable test cases, validation scenarios, reconciliation checks, automated scripts, and regression packs for repeatable data-quality assurance.

Write, optimize, and troubleshoot complex SQL queries and stored procedures across SQL Server, Oracle, PostgreSQL, or similar platforms.

Translate business rules, stored procedure logic, and post-trade process flows into automated validation scripts and assertions.

Build Python-based utilities, APIs, CLI tools, and reusable frameworks to support data validation, orchestration, API integrations, and reporting workflows.

Automate execution of AutoSys jobs, batch processes, stored procedures, and validation scripts across development, UAT, and production environments.

Work with engineering teams to embed data quality controls into pipelines, releases, and operational workflows.

Identify data anomalies, schema mismatches, duplicate records, null-handling issues, transformation failures, reconciliation breaks, and integrity violations.

Log defects with clear evidence, impact analysis, root-cause observations, and business context.

Support capital markets and post-trade validation across allocations, clearing, settlement, confirmations, reconciliations, market data, reference data, and downstream reporting.

Key competencies

5–7 years of hands-on experience in Data QA, Data Engineering QA, or Python-based automation roles.

Strong Python skills for data validation, automation framework development, regression testing, and pipeline verification.

Working knowledge of PySpark for validating large-scale data pipelines and distributed datasets.

Solid SQL skills for source-to-target validation, reconciliation, complex queries, stored procedures, schema checks, and defect analysis.

Experience in data QA, ETL/ELT testing, data pipeline testing, and regression testing across legacy and modern platforms.

Proven experience building automation-first regression frameworks, reusable validation scripts, test cases, and data verification utilities.

Strong understanding of data quality dimensions including accuracy, completeness, consistency, timeliness, uniqueness, referential integrity, and business-rule conformance.

Experience validating metadata, schema structures, data types, constraints, lineage, transformation logic, and downstream outputs.

Exposure to CI/CD tools such as Azure DevOps, Jenkins, or GitLab, with the ability to integrate automated tests and quality gates into deployment pipelines.

Familiarity with batch orchestration tools such as AutoSys, Control-M, or Airflow.

Good analytical skills to understand post-trade, financial, market data, or reference data and translate them into repeatable validation scenarios.

Experience with JIRA, XRay, agile delivery practices, defect management, and QA process governance.

Proficiency in leveraging AI-assisted tools such as Claude or GitHub Copilot to accelerate test case generation, SQL

development, data validation, defect analysis, documentation, and test data creation.

Strong communication, problem-solving, attention to detail, and cross-functional collaboration skills.

Nice to Have

Exposure to Azure, AWS, ADF, containers, Kubernetes, or cloud-based data platforms.

Experience with relational and NoSQL databases such as SQL Server, MongoDB, Cassandra, DynamoDB, or similar platforms.

Exposure to Hadoop, Spark, Databricks, cloud data lakes, and Big Data validation.

Experience validating batch, streaming, real-time, and Kafka-based ingestion pipelines.

Capital markets domain exposure, especially post-trade, market data, reference data, trade data, or ION/blotter platform integrations.

Exposure to DevSecOps, infrastructure as code, and code quality tools such as Terraform, Bicep, Sonar, Mend, or ZAP.

Job Snapshot

Job ID

JOB_7954

Department

Data and Technology Services

Location

ITPP-Kharadi, Pune, Maharashtra, India

Experience

5 - 7 Years

Employee Type

Permanent

Apply Now

Refine Your Search

big data engineer jobs in chakan pune maharashtra

Data QA Engineer - Delivery Lead

Data Scientist

AI Engineer

Lead AI Engineer

Back-End Developer (Java, Golang, Ruby, Python)

Lead Architect- AI/ML

Development Engineer 4

Senior DevOps Software Engineer

Sr. Engineer - Inference Engine

Senior Engineer - Global Test Automation Framework

Sr. Engineer - Virtual ECU Development

Sr. Engineer - Elastic Search

Sr. Engineer - Machine Learning

Related jobs to explore

I want to receive the latest job alerts for big data engineer in chakan pune maharashtra

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected