Software development engineer in test (sdet) engineering / quality Jobs

Senior AI Testing Engineer (Generative AI)
Wadhwani Foundation —Bengaluru, Karnataka
- Remote
- Azure
- DevOps
- Master's degree
Quick apply
14d
Senior QA Engineer
Clebu Technology Solutions —Kochi, Kerala
- ₹1,00,000 - ₹1,25,000 a month
- Full-time
- Hybrid work
- English
- Java
- JavaScript
Quick apply
13d
Test Automation (3-5 years)
Siemens —Pune, Maharashtra
- Full-time
- Azure
- Computer Science
- AWS
Tester III - Software Testing (Ecommerce/ATG Testing - Automation)
UST —Bengaluru, Karnataka
- Oracle
- Java
- APIs
7d
Sr QA Engineer
Tata Consultancy Services —Bengaluru, Karnataka
- Java
- AWS
- Bachelor's degree
Quality Assurance Engineer, Alexa Smart Properties
ADCI - Karnataka —Bengaluru, Karnataka
- Full-time
- Computer Science
- AWS
- Bachelor's degree
13d
Quality Assurance Engineer (QAE), Alexa Smart Properties
ADCI - Karnataka —Bengaluru, Karnataka
- Full-time
- Computer Science
- Java
- AWS
13d
Senior Quality Engineer
PayU —Bengaluru, Karnataka
- Oracle
- SQL
- AWS
Automation Tester, VP
Citi —Chennai, Tamil Nadu
- Full-time
- Microsoft Excel
- Oracle
- Computer Science
Quality Assurance Engineer II, Middle Mile, Relay TAQ
ADCI - Haryana —Gurugram, Haryana
- Full-time
- Java
- Scripting
- APIs
Senior IVR Quality Engineer
GCC India —Hyderabad, Telangana
- Full-time
- Azure
- Computer Science
- DevOps
12d
Solutions Quality Lead
HP —Bengaluru, Karnataka
- Full-time
- Azure
- Computer Science
- Java
Senior Lead Test Engineer (Playwright & Typescript)
Quest Global —Bengaluru, Karnataka
- Full-time
- Azure
- Databases
- AWS
Quick apply
Principal Eng, Test
Baxter —Bengaluru, Karnataka
- Azure
- English
- Research
- Paid time off
4d
Lead II - Software Testing (Selenium & Rest Assured)
UST —Thiruvananthapuram, Kerala
- Java
- APIs
7d
SDET / QA Automation Engineer – 3+ Years – Playwright Mandatory
Zerozila Infotech Pvt Ltd —Bengaluru, Karnataka
- ₹7,00,000 - ₹11,00,000 a year
- Full-time
- SQL
- APIs
- In-person
- Health insurance
Quick apply
Senior SDET (Automation + Manual - Web, API & Full-Stack Quality)
Codewinglet Private limited —Adajan, Surat, Gujarat
- ₹4,00,000 - ₹12,00,000 a year
- Full-time
- Computer Science
- Master's degree
- SQL
Quick apply
Senior Quality Engineer - Data
PayU —Mumbai, Maharashtra
- Oracle
- SQL
- AWS
Engineering Manager 2 - QA
LetsTransport —Bengaluru, Karnataka
- Full-time
- Azure
- Management
- Computer Science
Lead QA Engineer - Contract
WPP Production —Hyderabad, Telangana
- Hybrid work
- Computer Science
- Databases
- Bachelor's degree
- Flexible schedule
Quick apply
5d

I want to receive the latest job alerts for software development engineer in test (sdet) engineering / quality

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

software development engineer in test (sdet) engineering / quality jobs near

Automation Engineer jobs in Chennai, Tamil Nadu

Quality Assurance Manager jobs in Bengaluru, Karnataka

Full Stack Developer jobs in Surat, Gujarat

Quality Assurance Engineer jobs in Bengaluru, Karnataka

Principal Software Engineer jobs in Bengaluru, Karnataka

Senior Test Engineer jobs in Bengaluru, Karnataka

Quality Assurance Engineer jobs in Hyderabad, Telangana

Software Test Engineer jobs in Pune, Maharashtra

Senior Quality Engineer jobs in Mumbai, Maharashtra

Senior Quality Assurance Engineer jobs in Kochi, Kerala

Automation Engineer jobs in Bengaluru, Karnataka

Senior jobs in Kanpur, Uttar Pradesh

Chemist, Quality Control jobs in Indore, Madhya Pradesh

Senior Quality Assurance Engineer jobs in Thiruvananthapuram, Kerala

Quality Assurance jobs in Gurgaon South City I, Gurugram, Haryana

Quality Assurance jobs in Bhopal, Madhya Pradesh

Senior Quality Assurance Engineer jobs in Remote

Senior Quality Assurance Engineer jobs in Hosur, Tamil Nadu

Senior Quality Assurance Engineer jobs in Kerala

Automation Engineer jobs in Vadodara H.o, Vadodara, Gujarat

Senior AI Testing Engineer (Generative AI)

Wadhwani Foundation -
Bengaluru, Karnataka

Quick apply

Job details

14 days ago

Qualifications

CI/CD
Azure
Law
DevOps
Test automation
Performance testing
Master's degree
Databases
AWS
Continuous integration
APIs
Software testing
Integration testing
AI
MBA
Python

Full job description

Senior AI Testing Engineer (Generative AI)

Location India Remote / Hybrid / In-office — [specify your actual working model here]

Experience 5–8 years total experience in software testing, QA engineering, or SDET roles, with at least 2–3 years of meaningful, hands-on exposure to Generative AI systems, LLM applications, or AI quality engineering.

Role Overview

We are looking for a Senior AI Testing Engineer to own quality across our Generative AI products and platform.

This role is fundamentally about engineering quality into AI systems — not running test scripts. You'll design evaluation frameworks, build automated testing pipelines, and define what "good" looks like for LLM outputs, RAG systems, AI agents, and voice AI applications. You'll work directly with AI engineers and product teams to make sure our systems are reliable, safe, and measurably improving over time.

If you understand how LLMs fail, know how to catch hallucinations before users do, and want to build the quality infrastructure that underpins production AI at scale — this is the role.

Key Responsibilities

Evaluation Strategy & Frameworks

Design and own comprehensive testing strategies for Generative AI products — including LLM applications, RAG pipelines, AI agents, voice AI systems, and workflow automation
Define evaluation methodologies covering functional testing, response quality, hallucination detection, safety and guardrail testing, prompt injection, bias and toxicity, retrieval quality, latency benchmarking, and agent workflow validation
Build reusable AI testing frameworks and automation pipelines for continuous evaluation
Create datasets, benchmark suites, and golden test sets for GenAI evaluation

Automated Evaluation

Develop automated evaluation pipelines using LLM-as-a-Judge and hybrid evaluation methods
Implement CI/CD-integrated AI evaluation pipelines
Drive observability and monitoring strategies for production AI systems

Quality Standards & Collaboration

Define measurable quality KPIs for AI systems
Establish testing standards, best practices, and governance processes for GenAI applications
Work closely with AI engineers, product, and platform teams to embed quality throughout the development lifecycle

Required Skills & Experience

Testing & Engineering Experience

5–8 years in software testing, QA engineering, SDET, or test automation
2–3 years of hands-on experience testing or evaluating production-grade Generative AI or LLM-based systems
Strong test automation skills in Python
Experience designing scalable automated testing frameworks
Familiarity with API testing, integration testing, and performance testing

Generative AI Knowledge

Solid understanding of how LLM systems work — and how they fail
Experience with RAG architectures, prompt engineering, AI agents, embedding models, and vector databases
Understanding of LLM evaluation methodologies and AI system failure modes

GenAI Testing Frameworks

Hands-on experience with at least one or more GenAI evaluation frameworks, such as: DeepEval, Ragas, LangSmith, Promptfoo, TruLens, OpenAI Evals, or LangChain evaluation tools

Quality Engineering

Expertise in test strategy, test planning, test automation architecture, defect lifecycle management, and quality metrics
Ability to define and track measurable quality KPIs for AI systems

Preferred Qualifications

Experience with cloud platforms (AWS, Azure, or GCP)
Familiarity with MLOps / LLMOps workflows
Experience with CI/CD pipelines and DevOps practices
Exposure to monitoring and observability tooling for AI systems
Understanding of security and compliance for GenAI products
Experience with conversational AI or voice AI systems

MBA

Quick apply

Refine Your Search

Senior AI Testing Engineer (Generative AI)

Senior QA Engineer

Test Automation (3-5 years)

Tester III - Software Testing (Ecommerce/ATG Testing - Automation)

Sr QA Engineer

Quality Assurance Engineer, Alexa Smart Properties

Quality Assurance Engineer (QAE), Alexa Smart Properties

Senior Quality Engineer

Automation Tester, VP

Quality Assurance Engineer II, Middle Mile, Relay TAQ

Senior IVR Quality Engineer

Solutions Quality Lead

Senior Lead Test Engineer (Playwright & Typescript)

Principal Eng, Test

Lead II - Software Testing (Selenium & Rest Assured)

SDET / QA Automation Engineer – 3+ Years – Playwright Mandatory

Senior SDET (Automation + Manual - Web, API & Full-Stack Quality)

Senior Quality Engineer - Data

Engineering Manager 2 - QA

Lead QA Engineer - Contract

I want to receive the latest job alerts for software development engineer in test (sdet) engineering / quality

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected