T&T| Customer| S&S| Consultant | AI Tester | Bangalore
- Job requisition ID : 106454
- Location: Pune
- Entity: Deloitte Touche Tohmatsu India LLP
The team
Customer has to do much more than keep the wheels turning; it is the engine that drives functional excellence and the enabler of innovation and long-term growth. Learn more about: Customer
Your work profile
As a Consultant in our Consulting team, you’ll work with teams and clients to ensure the quality, reliability, accuracy, and safety of AI-powered solutions.
- Design and execute test plans, test cases, and test scenarios for AI/ML applications.
- Validate functional, performance, reliability, and accuracy aspects of Generative AI, LLM, chatbot, and conversational AI solutions.
- Evaluate AI responses for accuracy, relevance, consistency, factual correctness, and adherence to business requirements.
- Perform prompt testing, prompt validation, and regression testing for LLM-based applications.
- Identify and document defects, hallucinations, bias, inconsistencies, and AI-specific edge cases.
- Validate data quality, input/output behaviour, and model performance across different datasets and user scenarios.
- Collaborate with developers, data scientists, ML engineers, and business teams to resolve issues and improve solution quality.
- Prepare test plans, test reports, defect reports, and other project documentation.
- Stay updated with emerging AI/ML and Generative AI trends and apply relevant testing practices.
Key skills required:
- 2–4 years of experience in Software Testing, QA, AI/ML Testing, or related areas.
- Hands-on experience testing AI/ML applications, Generative AI, LLMs, chatbots, or conversational AI.
- Strong understanding of testing methodologies, SDLC/STLC, Agile, and QA processes.
- Experience in prompt testing, LLM response evaluation, regression testing, and defect management.
- Strong analytical, problem-solving, communication, and stakeholder management skills.
- Knowledge of Python, SQL, API testing, automation, or AI evaluation tools will be an added advantage.
Desired Qualifications:
- 2–4 years of relevant experience in AI/ML Testing or QA.
- Experience in at least one end-to-end AI/ML or Generative AI implementation.
- Graduate degree in Computer Science, IT, Engineering, Data Science, AI, or a related discipline.
Location and way of working:
- Base location: Bangalore
- Willingness to travel for short- and long-term durations
