Remote Computer system validation Jobs – 109 Open Jobs Today

QA Tester – AI Observability & Monitoring
TestUnity —Remote
- ₹1,000 - ₹1,200 an hour
- Remote
- Computer Science
- Master's degree
- SQL
Quick apply
3d
IoT Engineer
V BIKE —Remote
- From ₹15,000 a month
- Full-time
- Remote
- Computer Science
- Software troubleshooting
- Analysis skills
- Flexible schedule
- Food provided
Quick apply
Quality Assurance Analyst
Miracuves —Remote
- ₹6,000 a month
- Full-time
- Remote
- Computer Science
- B.Sc
- Master's degree
- Work from home
- Paid sick time
Quick apply
CRM Tester
Liventus —Remote
- Remote
- Computer Science
- SQL
- Analysis skills
- Health insurance
11d
Technical Product Manager
SupplyHouse.com —Remote
- ₹37,000 - ₹46,000 a year
- Full-time
- Remote
- Azure
- English
- Java
- Paid time off
- Work from home
Quick apply
Senior Marketing Technology Specialist (Employer of Record)
Credit Acceptance —Remote
- ₹34,76,326 - ₹55,62,122 a year
- Full-time
- Remote
- Computer Science
- SQL
- AWS
2d
Data Engineer
Kashcomp LLC —Remote
- ₹60,000 - ₹95,000 a month
- Full-time
- Remote
- Azure
- Computer Science
- DevOps
Quick apply
3d
AI/ML Engineer
Expertshub.ai —Remote
- ₹3,93,202.28 - ₹16,33,332.74 a year
- Remote
- Azure
- Computer Science
- B.Sc
- Paid holidays
- Health insurance
Quick apply
Empower Chromatography Data System (CDS) System Administrator (Instruments Focus)
ITSoli India Pvt Ltd. —Remote
- Up to ₹25,00,000 a year
- Overnight shift
- Remote
- Software troubleshooting
- Laboratory experience
- Windows
- Work from home
Quick apply
11d
PHP Developer - Intern
MNJ Software —Remote
- Full-time
- Remote
- Computer science
- Computer Science
- English
- Work from home
Senior Data Engineer
A & B Business Solutions —Remote
- ₹10,09,356.57 - ₹30,66,829.63 a year
- Full-time
- Remote
- Microsoft Excel
- Azure
- Computer Science
- Health insurance
- Work from home
Quick apply
DevOps Monitoring Engineer - Configuration Management
MNJ Software —Remote
- Full-time
- Remote
- Software troubleshooting
- DevOps
- English
- Work from home
ETL Test Engineer
Appzlogic Mobility Solutions Pvt Ltd —Remote
- Full-time
- Remote
- Azure
- Oracle
- Computer Science
- Health insurance
- Cell phone reimbursement
Quick apply
1d
DevOps Monitoring Engineer-Configuration Management
MNJ Software —Remote
- Full-time
- Remote
- DevOps
- English
- Java
- Work from home
Adobe Analytics Expert
MNJ Software —Remote
- Full-time
- Remote
- Computer Science
- English
- Administrative experience
- Work from home
Associate Manager, IT
Thermo Fisher Scientific —Remote
- Full-time
- Remote
- Management
- Customer service
- Supervising experience
Data Engineer (GCP)
Rupa Career Solutions —Remote
- ₹5,09,356.57 - ₹10,66,829.63 a year
- Full-time
- Remote
- Computer Science
- DevOps
- SQL
Quick apply
AWS Cloud Engineer – Cybersecurity Labs & CTF Development
Jyotirgamay Solutions Pvt Ltd —Remote
- From ₹20,000 a month
- Email
- Remote
- Computer Science
- DevOps
- AWS
Quick apply
AI Engineer (Remote, IND)
CrowdStrike —Remote
- Full-time
- Remote
- Computer Science
- Salesforce
- DevOps
8d
Freelance -Multi-Agent Systems
Guires Solutions Private Limited —Remote
- From ₹10,000 a month
- Part-time
- Remote
- Doctoral degree
- Computer Science
- Research
Quick apply

I want to receive the latest job alerts for computer system validation in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

QA Tester – AI Observability & Monitoring

TestUnity
Remote

Quick apply

Job details

Contractual / Temporary
₹1,000 - ₹1,200 an hour
3 days ago

Qualifications

BCS
Law
Computer Science
Test automation
Master's degree
SQL
Bachelor's degree
APIs
Data science
AI
Python
Data Science
SDLC

Full job description

Job Title: QA Tester – AI Observability & Monitoring
Duration: 6 Months Contract with a possibility for an extension
Location: Offshore - India / 100% Remote

Rate: INR 1200 per hour

Experience Required: 8+ years in QA and at least 2 years in AI ML related projects. Should have Observability and Monitoring experience.

Role Overview:
We are seeking a QA Tester specializing in AI Observability and Monitoring to support the validation and continuous monitoring of AI/ML solutions in a regulated enterprise environment.
This role will focus on ensuring that AI systems are traceable, explainable, and continuously performing as expected by validating observability frameworks, monitoring pipelines, and model performance metrics. The candidate will work closely with AI engineers, data scientists, and validation teams to ensure AI solutions meet quality, compliance, and audit readiness standards.

Key Responsibilities
1. AI Observability Validation

Validate observability instrumentation across AI systems, including:
Input/output tracing
Telemetry data (latency, token usage, cost, etc.)
Ensure all observability signals are captured, linked, and auditable
Verify traceability and explainability of model behaviour across workflows

2. AI Model Monitoring & Drift Testing

Validate monitoring frameworks for:
Model performance (accuracy, confidence, consistency)
Drift detection and threshold-based alerts
Test alerting mechanisms and escalation workflows for:
Performance degradation
Anomalous outputs
Support continuous monitoring validation in production environments

3. AI Behavior & Functional Testing

Design and execute test scenarios covering:
Edge cases and ambiguous inputs
Prompt variations and response consistency
Bias and fairness validation
Validate model outputs against expected results and SME benchmarks
Perform comparative validation (AI vs. baseline/manual outputs)

4. Observability Tools & Integration Testing

Test integration between AI applications and observability tools (e.g., Langfuse or similar platforms)
Validate data pipelines feeding observability dashboards and KPI metrics
Ensure end-to-end visibility across AI lifecycle (development → QA → production)

5. Non-Functional & System Quality Testing

Validate non-functional requirements including:
Performance and latency
Reliability and resilience
Logging and auditability
Ensure monitoring coverage aligns with enterprise quality and governance standards

6. Audit, Compliance & Documentation

Maintain audit-ready documentation for:
Test cases, execution results, and validation evidence
Ensure alignment with:
SDLC validation processes
AI governance and compliance requirements
Support inspection readiness and audit responses as needed

Required Qualifications

Bachelor’s degree in Computer Science, Data Science, Engineering, or related field
3–7 years of experience in QA / Testing / Validation
Experience working with AI/ML systems or data-driven applications
Exposure to monitoring systems, logging frameworks, or observability platforms

Technical Skills

Strong understanding of:
AI/ML concepts (LLMs, model behavior, drift, evaluation metrics)
Experience with:
API testing and backend validation
SQL / data validation techniques
Familiarity with:
Observability tools (e.g., Langfuse, logging/monitoring platforms)
Test management tools (e.g., QTest, ALM tools)

QA & Validation Skills

Experience designing:
Functional and non-functional test scenarios
Edge case and negative testing scenarios
Understanding of:
Test automation concepts (Python preferred)
End-to-end validation lifecycle

Preferred Qualifications

Experience in GenAI / LLM testing
Knowledge of:
Prompt engineering and evaluation methods
Familiarity with:
GxP / regulated industry environments
AI governance, explainability, and Responsible AI frameworks

Pay: ₹1,000.00 - ₹1,200.00 per hour

Application Question(s):

1. Total Years of Experience (QA/Testing): ___

2. Relevant Years of Experience in AI/ML, GenAI, or LLM Testing:
3. Do you have experience in AI Observability and Monitoring?
4. Do you have experience testing GenAI/LLM applications?
5. Years of API Testing Experience:
6. Current CTC (Fixed + Variable):
7. Expected CTC:
8. Notice Period:
9. Current location:
10. Native/hometown:

Work Location: Remote

Quick apply

Refine Your Search

computer system validation jobs in remote

QA Tester – AI Observability & Monitoring

IoT Engineer

Quality Assurance Analyst

CRM Tester

Technical Product Manager

Senior Marketing Technology Specialist (Employer of Record)

Data Engineer

AI/ML Engineer

Empower Chromatography Data System (CDS) System Administrator (Instruments Focus)

PHP Developer - Intern

Senior Data Engineer

DevOps Monitoring Engineer - Configuration Management

ETL Test Engineer

DevOps Monitoring Engineer-Configuration Management

Adobe Analytics Expert

Associate Manager, IT

Data Engineer (GCP)

AWS Cloud Engineer – Cybersecurity Labs & CTF Development

AI Engineer (Remote, IND)

Freelance -Multi-Agent Systems

I want to receive the latest job alerts for computer system validation in remote

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected