chennai tamil nadu operations risk control architecture design Jobs – 82 Open Jobs Today

Data Quality Engineer (Databricks)
Datamatics Technologies —Chennai, Tamil Nadu
- Full-time
- Azure
- SQL
- Machine learning
Quick apply
1d
Director, Enterprise Data Observability Lead
AstraZeneca —Chennai, Tamil Nadu
- Full-time
- DevOps
- Leadership
8d
IN-Manager_Cybersecurity_OT Security_Advisory_Chennai
PwC —Chennai, Tamil Nadu
- Full-time
- Master's degree
- Analysis skills
- Bachelor's degree
10d
Lead Consultant - SAP BTP
AstraZeneca —Chennai, Tamil Nadu
- Full-time
- Java
- JavaScript
- AI
3d
Senior Specialist-SAP BSA
Lennox International —Chennai, Tamil Nadu
- Full-time
- Azure
- ERP systems
- Bachelor's degree
9d
Senior Enterprise Software Engineer -AI Operations
Wolters Kluwer —Chennai, Tamil Nadu
- Full-time
- Azure
- Salesforce
- Master's degree
Security Engineer III
Pearson —Chennai, Tamil Nadu
- Full-time
- Microsoft Access
- Azure
- Management
Senior Manager - SAP Analytics Cloud & Datasphere
AstraZeneca —Chennai, Tamil Nadu
- Full-time
- Computer Science
- DevOps
- English
Lead DevOps Engineer
TransUnion —Chennai, Tamil Nadu
- Full-time
- Computer networking
- APIs
- Leadership
Senior Pre Sales Engineer –Delivery Lead (BMS)
Siemens —Chennai, Tamil Nadu
- Full-time
- Microsoft Powerpoint
- Microsoft Word
- Microsoft Excel
Principal Security Engineer
DHL —Chennai, Tamil Nadu
- Hybrid work
- Azure
- Management
- AWS
- Health insurance
DevSecOps – Staff Engineer
Forbes Advisor —Chennai, Tamil Nadu
- Weekend availability
- DevOps
- Windows
- AWS
Quick apply
Senior Engineer - Electrical (Subsea)
Wood —Chennai, Tamil Nadu
- Full-time
- Project management
- Electrical experience
- Bachelor's degree
Senior Security Engineer II – Enterprise & IT Security
Poshmark —Chennai, Tamil Nadu
- Full-time
- In-person
- Communication skills
- Python
Senior AI / ML OPS Engineer – Agentic AI for IT Production
CGI —Chennai, Tamil Nadu
- Full-time
- Computer Science
- DevOps
- Engineering
Quick apply
1d
Software Engineer III, Max Digital
ACV Auctions —Chennai, Tamil Nadu
- Full-time
- Computer Science
- B.Sc
- English
Quick apply
NIAM Support
NCR —Chennai, Tamil Nadu
- Full-time
- Microsoft Access
- Azure
- Oracle
15h
Site Reliability Engineer III
LexisNexis Risk Solutions —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- B.Sc
- Health insurance
21h
Senior SQA Analyst
Contiem —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- Engineering
Quick apply
6h

Other jobs to consider

Find your next job by exploring related positions.

Capital Markets Services Associate
Accenture —Chennai, Tamil Nadu
Roles and Responsibilities: •In this role you are required to solve routine problems, largely through precedent and referral to general guidelines • Your…
Head of IT
Nordex SE —Chennai, Tamil Nadu
Ensure that delivery capabilities are aligned with global IT frameworks, architectures, and service models. Exposure to India’s IT ecosystem is an advantage.

I want to receive the latest job alerts for operations risk control architecture design in chennai tamil nadu

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

operations risk control architecture design jobs near chennai tamil nadu

Senior Ai Ml Engineer jobs in Chennai, Tamil Nadu

Site Reliability Engineer jobs in Chennai, Tamil Nadu

Senior Software Engineer jobs in Chennai, Tamil Nadu

Data Engineer jobs in Chennai, Tamil Nadu

Occupational Therapist jobs in Chennai, Tamil Nadu

Lead Consultant jobs in Chennai, Tamil Nadu

Devops Engineer jobs in Chennai, Tamil Nadu

Senior Analyst jobs in Chennai, Tamil Nadu

Senior Cloud Analyst jobs in Remote

Senior Cloud Analyst jobs in Madhapur, Hyderabad, Telangana

Senior Hr Manager jobs in Bengaluru, Karnataka

Sales Executive Work From Home jobs in Tamil Nadu

Senior Company Secretary jobs in Mumbai, Maharashtra

Senior Architect jobs in Hyderabad, Telangana

Senior Sales Lead jobs in Tiruchchirappalli, Tamil Nadu

Senior Accountant jobs in Cbd Belapur, Navi Mumbai, Maharashtra

Mechanical Engineer jobs in Gachibowli, Hyderabad, Telangana

Design Engineer jobs in Khed Shivapur, Pune, Maharashtra

Senior Citizens jobs in Hyderabad, Telangana

Spring Dale Senior School,amritsar jobs in Amritsar, Punjab

Data Quality Engineer (Databricks)

Datamatics Technologies -
Chennai, Tamil Nadu

Quick apply

Job details

Full-time
1 day ago

Qualifications

Power BI
Azure
Software deployment
SQL
Machine learning
Unity
Metadata
AI

Full job description

Job Description – Data Quality Engineer (Databricks) – x 4 Positions
Location: Abudhabi - UAE - Onsite
Open to Relocate
Duration: 6 months ( Extendable to One Year)
Experience: 5 to 7 Years
Project start date is 1st July - Immediate joiners will be preferred

Role Overview
The Data Quality Engineer will be responsible for designing, implementing, and operating ADC's enterprise data quality framework within the Databricks platform. The role will deliver automated profiling, quality rule execution, cleansing, monitoring, remediation support, and quality reporting capabilities across 170 datasets and 1,346 prioritised Critical Data Elements (CDEs).
Working closely with Data Modellers, Data Catalogue Specialists, business data owners, and platform engineers, the Data Quality Engineer will establish scalable and reusable quality controls that improve trust, accuracy, completeness, consistency, timeliness, validity, and uniqueness across ADC's data estate.
Key Responsibilities
Databricks Platform Configuration and Administration

Configure and manage the Databricks environment supporting enterprise data quality operations.
Establish and maintain:
- Compute clusters.
- PySpark notebook frameworks.
- Delta Lake storage structures.
- Unity Catalog integration.
Optimise platform performance for large-scale profiling and rule execution across all in-scope datasets and CDEs.
Implement development, testing, and production deployment standards for data quality assets.

Data Profiling and Quality Assessment

Design and develop AI-assisted profiling notebooks using PySpark.
Perform baseline data quality assessments across the six quality dimensions:
- Completeness.
- Accuracy.
- Consistency.
- Validity.
- Timeliness.
- Uniqueness.
Capture and analyse:
- Null value rates.
- Duplicate records.
- Invalid values.
- Format violations.
- Outliers.
- Schema drift.
Produce quality profiling outputs for all prioritised CDEs and datasets.

Data Quality Rule Factory Development

Design and implement a reusable Data Quality Rule Factory.
Build parameterised PySpark-based rule templates capable of supporting large-scale rule deployment.
Enable automated generation and management of approximately 6,730 data quality rules without manual rule-by-rule development.
Ensure rules are reusable, configurable, and maintainable across multiple datasets and domains.

Data Quality Controls and Pipeline Integration

Deploy quality rules as reusable Databricks Jobs integrated into Delta Lake processing pipelines.
Embed quality controls within Bronze, Silver, and Gold processing stages.
Implement automated quality gates preventing data progression where defined thresholds are not met.
Maintain rule traceability and execution history for audit and governance purposes.

Data Cleansing and Quality Improvement

Develop automated remediation and cleansing pipelines using PySpark.
Implement:
- Standardisation routines.
- Data enrichment processes.
- Deduplication logic.
- Schema harmonisation controls.
Deploy machine learning models managed through MLflow for:
- Anomaly detection.
- Exact duplicate detection.
- Fuzzy matching and duplicate identification.
Ensure all AI and ML recommendations are explainable, auditable, and routed through human-in-the-loop validation processes where required.

Exception Management and Reprocessing

Design and manage exception handling processes for failed quality records.
Implement quarantine Delta Lake tables serving as the Failed Record Register.
Capture and maintain:
- Failure reason.
- Associated CDE.
- Rule reference.
- Processing timestamp.
- Resolution status.
Develop reprocessing workflows to support correction and controlled re-ingestion of remediated records.

Data Quality Metrics and Reporting

Develop Delta Lake metric aggregation structures supporting enterprise quality reporting.
Calculate and publish:
- Data Quality Index (DQI) scores.
- Dimension-level quality metrics.
- Rule pass/fail rates.
- Dataset compliance scores.
- SLA adherence indicators.
Provide curated outputs to support Power BI quality dashboards and executive reporting.

Monitoring, Alerting and Predictive Quality Management

Configure automated quality monitoring and alerting mechanisms.
Implement threshold-based notifications using:
- Databricks SQL Alerts.
- Azure Monitor integrations.
Develop predictive risk scoring models to identify datasets at risk of future quality degradation.
Support proactive quality management and operational intervention activities.

Root Cause Analysis and Remediation Support

Apply Databricks machine learning and pattern analysis techniques to profiling and rule execution outputs.
Support AI-assisted root cause analysis across established remediation categories.
Identify recurring quality issues, systemic defects, and process breakdowns.
Produce prioritised remediation datasets for business and operational stakeholders.
Export remediation outputs to Power BI and Excel to support:
- Remediation Tiering Matrix.
- Prioritisation Scoring Models.
- Governance reporting processes.

Governance, Compliance and Stakeholder Engagement

Collaborate with Data Modellers and Data Catalogue Specialists to ensure quality controls align with authoritative data definitions and metadata standards.
Support DDA and DGE governance processes by producing required quality artefacts and evidence.
Maintain documentation, version control, and audit trails for all quality assets, rules, models, and processes.
Participate in quality reviews, governance forums, and stakeholder workshops.

Required Skills and Experience

Strong experience designing and implementing enterprise Data Quality frameworks.
Advanced Databricks engineering experience.
Strong PySpark development skills.
Experience with:
- Delta Lake.
- Unity Catalog.
- Databricks Workflows and Jobs.
- Databricks SQL.
Experience building scalable data validation and quality rule frameworks.
Knowledge of machine learning techniques for anomaly detection and data quality monitoring.
Experience using MLflow for model management and deployment.
Strong understanding of data governance, metadata management, and data lifecycle processes.
Experience integrating data quality metrics into reporting platforms such as Power BI.
Knowledge of cloud-based data engineering and modern lakehouse architectures.

Deliverables

Configured Databricks Data Quality environment.
Enterprise Data Quality Rule Factory.
AI-assisted profiling notebooks and baseline assessment outputs.
Automated data quality validation and gating processes.
Data cleansing and remediation pipelines.
Failed Record Register and reprocessing workflows.
Data Quality metric aggregation tables.
DQI reporting feeds and dashboard datasets.
Predictive quality monitoring and alerting solutions.
Root Cause Analysis and remediation support datasets.
Governance, audit, and compliance artefacts supporting DDA and DGE reviews.

umERuPOEQe

Quick apply

Refine Your Search

operations risk control architecture design jobs in chennai tamil nadu

Data Quality Engineer (Databricks)

Director, Enterprise Data Observability Lead

IN-Manager_Cybersecurity_OT Security_Advisory_Chennai

Lead Consultant - SAP BTP

Senior Specialist-SAP BSA

Senior Enterprise Software Engineer -AI Operations

Security Engineer III

Senior Manager - SAP Analytics Cloud & Datasphere

Lead DevOps Engineer

Senior Pre Sales Engineer –Delivery Lead (BMS)

Principal Security Engineer

DevSecOps – Staff Engineer

Senior Engineer - Electrical (Subsea)

Senior Security Engineer II – Enterprise & IT Security

Senior AI / ML OPS Engineer – Agentic AI for IT Production

Software Engineer III, Max Digital

NIAM Support

Site Reliability Engineer III

Senior SQA Analyst

Other jobs to consider

I want to receive the latest job alerts for operations risk control architecture design in chennai tamil nadu

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected