Tn Senior python automation test engineer Jobs – 142 Open Jobs Today

Senior AI QA Analyst
Shifastar —Chennai, Tamil Nadu
- Azure
- Computer Science
- Master's degree
4h
Sr Technical Consultant - Cloud - Devops,Kubernetes,Terraform,Scrpiting
Blue Yonder —Coimbatore, Tamil Nadu
- Full-time
- Azure
- DevOps
- Java
Full Stack Engineering Lead – AI & GenAI
WPP —Chennai, Tamil Nadu
- Hybrid work
- Azure
- DevOps
- Java

Other jobs to consider

Find your next job by exploring related positions.

Senior Python Application Developer
Citi —Chennai, Tamil Nadu
Comprehensive hands-on experience with diverse database technologies, including advanced SQL optimization for relational databases (e.g., PostgreSQL, Oracle,…
Senior AI QA Analyst
Shifastar —Chennai, Tamil Nadu
Experience creating evaluation datasets and defining success criteria for AI behavior. You will work closely with Data Science, AI Engineering, and Platform…
4h

I want to receive the latest job alerts for senior python automation test engineer in tn

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

senior python automation test engineer jobs near tn

Automation Engineer jobs in Chennai, Tamil Nadu

Senior Technical Consultant jobs in Bengaluru, Karnataka

Senior Manager Hr jobs in Chennai, Tamil Nadu

Senior Technical Consultant jobs in Delhi, Delhi

Senior Technical Consultant jobs in Kochi, Kerala

Concentrix, Non Voice Advisor, Technical Support jobs in Bengaluru, Karnataka

Technical Support, Product Based Company jobs in Bengaluru, Karnataka

Senior Technical Consultant jobs in Thane, Maharashtra

Hr Consultant jobs in Remote

Senior Quality Assurance Analyst jobs in Verna, GOA

Senior Quality Assurance Analyst jobs in Mumbai, Maharashtra

Startup Data Analyst jobs in Chennai, Tamil Nadu

Financial Analyst jobs in Delhi, Delhi

Senior Quality Assurance Analyst jobs in Bengaluru, Karnataka

Data Analyst Fresher jobs in Tamil Nadu

Senior Quality Assurance Analyst jobs in Vadodara, Gujarat

Fresher Data Analyst jobs in Kolkata, West Bengal

Engineer jobs in Lucknow, Uttar Pradesh

Automation Engineer jobs in Surat, Gujarat

Tata Projects, Civil Engineer jobs in Assam

Senior AI QA Analyst

Shifastar
Chennai, Tamil Nadu

Apply Now

Job details

4 hours ago

Qualifications

BCS
CI/CD
Azure
Law
Computer Science
Software deployment
Test automation
Selenium
Master's degree
AWS
Bachelor's degree
Continuous integration
SDKs
Scripting
APIs
IT
Data science
AI
Communication skills
Python
Debugging
Information Technology

Full job description

We have an urgent opportunity for Senior AI QA Analyst (Selenium/ AI/ LLM/ GenAI/ Agent-based Testing) position with a Leading global provider of business decisioning data and analytics

CANDIDATES WITH IMMEDIATE TO 30 DAYS JOINING

Below are Job details –

The Role:

We are looking for a highly skilled AI Tool / Agent Testing Engineer to evaluate, validate, and ensure the reliability of AI agents, AI automation tools, and agentic workflows used across our analytics platform.

This role blends test engineering, GenAI understanding, Python/PySpark proficiency, and agent development lifecycle knowledge.

You will work closely with Data Science, AI Engineering, and Platform teams to ensure that AI agents behave predictably, safely, and in alignment with business and compliance requirements.

Key Responsibilities:

Agent & AI Tool Testing

Design and execute test strategies for LLM agents, multi agent workflows, and automation tools.

Validate reasoning paths, tool calls, workflows, and guardrails.

Assess regression, functionality, performance, safety, and hallucination risks.

Agent Development Lifecycle (ADLC)

Partner with AI engineers on prompts, knowledge sources, skills, and tool integrations.

Validate interoperability with APIs, databases, vector stores, and orchestration frameworks.

Ensure accuracy, consistency, tool-call reliability, trace quality, and guardrail adherence.

GenAI & Workflow Validation

Test RAG systems for grounding and factual correctness.

Validate sequential, loop, and parallel agent workflows.

Ensure compliance with AI governance and security standards.

Test Automation Frameworks

Build Python/PySpark utilities to automate scenarios, input generation, metrics, and trace analysis.

Develop reusable test harnesses for agent evaluation pipelines.

Documentation & Reporting

Produce test plans, scenario libraries, coverage reports, and defect logs.

Deliver insights to Data Science & Engineering teams to improve reliability.

Key Requirements:

5+ years of overall experience in software engineering, data science, or AI/ML development, with at least 3 to 5 years focused on AI/LLM/GenAI testing or agent-based systems.

Python expertise in scripting, automation, and debugging.

Strong PySpark experience in distributed testing, data validation, and pipeline testing.

Hands-on knowledge of GenAI concepts, including LLMs, prompting, context management, RAG pipelines, agent tool-calling, and multi-agent orchestration.

Experience with agent development and deployment frameworks such as LangGraph, AutoGen, CrewAI, Copilot Studio Agent SDK, and Vertex AI/OpenAI agent frameworks.

Solid understanding of agent architecture covering skills, tools, connectors, memory, guardrails, and observability.

Familiarity with modern GenAI/agent evaluation frameworks such as Langsmith evaluation, AutoGen agent-behavior assessment utilities etc. for benchmarking reliability, grounding, tool-use correctness, and multi-agent performance.

Strong foundation in functional and regression testing, scenario and edge-case testing, LLM safety and hallucination testing, and workflow validation.

Experience creating evaluation datasets and defining success criteria for AI behavior.

Good understanding of API testing frameworks, data engineering concepts, cloud workflow execution (Azure/GCP/AWS), and CI/CD pipelines for test automation.

Excellent communication skills for cross-functional collaboration.

Job Location: Chennai or Hyderabad

Education: Bachelor’s degree in computer science/ information technology

Experience: 5 to 10 years

Apply Now

Refine Your Search

senior python automation test engineer jobs in tn

Senior AI QA Analyst

Sr Technical Consultant - Cloud - Devops,Kubernetes,Terraform,Scrpiting

Full Stack Engineering Lead – AI & GenAI

Other jobs to consider

I want to receive the latest job alerts for senior python automation test engineer in tn

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected