Job Summary
We are seeking an experienced Quality AI Analyst with expertise in Agentic AI solutions to drive quality
assurance initiatives across AI-powered applications and intelligent agent workflows. The ideal candidate
will be responsible for defining quality standards, designing validation strategies, executing comprehensive
testing, and ensuring AI solutions meet business, customer, security, and compliance requirements.
Key Responsibilities
Quality Assurance & Testing
Support and execute Regression Testing, Smoke Testing, Sanity Testing, and System Integration
Testing (SIT) activities.
Design, develop, and execute test cases for AI-enabled and agentic applications.
Ensure complete test coverage across functional and non-functional requirements.
Analyze test failures, document defects clearly, and collaborate with development teams on root-
cause analysis.
Stakeholder Collaboration
Work closely with Developers, Business Analysts, Product Owners, and Engineering teams to
ensure requirements are testable and meet quality standards.
Participate in requirement reviews and provide quality assurance inputs during the development
lifecycle.
Automation & Quality Improvement
Identify test scenarios suitable for automation and contribute to increasing automation coverage.
Recommend and implement best practices for AI quality assurance and continuous testing.
AI & Agentic Solution Validation
Define testable AI and agentic requirements by translating business use cases, prompts, workflows,
and expected outcomes into measurable quality scenarios and acceptance criteria.
Design and execute validation strategies for:
o Functional Testing
o Integration Testing
o Regression Testing
o Performance & Non-Functional Testing
o Security & Compliance Validation
o Operational Readiness Testing
Risk & Defect Management
Proactively identify quality risks, defects, and assurance gaps during the development lifecycle.
Manage issues through effective:
o Defect Triage
o Traceability Management
o RAID (Risks, Assumptions, Issues, Dependencies) Tracking
o Escalation Management
Ensure production leakage is minimized through robust quality processes.
Required Skills & Experience
7–10 years of experience in Quality Assurance and Testing.
Strong understanding of software testing methodologies and QA processes.
Experience in testing AI/ML-based applications and Agentic AI solutions.
Knowledge of test automation frameworks and tools.
Experience with defect management and test management tools.
Strong analytical, problem-solving, and communication skills.
Ability to collaborate effectively with cross-functional teams.
Preferred Skills
Experience working in Agile/Scrum environments.
Exposure to Generative AI, LLM-based applications, and AI workflow validation.
Understanding of security, compliance, and governance requirements for AI systems.
Knowledge of performance and reliability testing for AI applications.
