AI Quality Engineering (AI QE) Engineer
Location: Bangalore, India
Experience: 7–15 Years
Notice Period: Immediate Joiners or Serving Notice Period Preferred
Job Summary
We are looking for an experienced AI Quality Engineering (QE) Engineer to design and implement quality assurance strategies for AI/ML and Generative AI applications. The ideal candidate will have strong expertise in test automation, API testing, AI model validation, and modern QA practices, with experience in validating LLM-based applications and AI-driven workflows.
Key Responsibilities
- Develop and execute AI testing strategies for GenAI, LLM, and ML-based applications.
- Build and maintain automation frameworks using Playwright, Selenium, Cypress, or PyTest.
- Validate AI model outputs for accuracy, hallucinations, bias, safety, and consistency.
- Perform API, UI, integration, regression, and performance testing.
- Create AI evaluation datasets, test scenarios, and benchmark reports.
- Integrate automated tests into CI/CD pipelines using Jenkins, GitHub Actions, or Azure DevOps.
- Collaborate with AI Engineers, Developers, Product Managers, and DevOps teams.
- Mentor QE engineers and drive quality best practices across projects.
Required Skills
- 7–15 years of Quality Engineering or Test Automation experience.
- Strong programming skills in Java or Python.
- Experience with Selenium, Playwright, Cypress, Rest Assured, or PyTest.
- API testing using Postman or REST Assured.
- Hands-on experience with CI/CD tools (Jenkins, GitHub Actions, Azure DevOps).
- Knowledge of SQL and databases.
- Experience testing AI/ML or GenAI applications.
- Understanding of Prompt Engineering, Retrieval-Augmented Generation (RAG), embeddings, vector databases, and LLM evaluation.
- Familiarity with cloud platforms (AWS, Azure, or GCP).
Rekha.C@eagledrift.com
Pay: ₹300,000.00 - ₹2,200,000.00 per month
Work Location: In person
