Quality Assurance (QA) Engineer – 2 to 3 Years Experience
Job Title - QA Engineer / Software Test Engineer
Experience - 2–3 Years
Location - Pune
Job Summary
We are looking for a detail-oriented QA Engineer with 2–3 years of experience in software testing. The ideal candidate should have strong knowledge of Agile methodologies, manual testing fundamentals, automation testing using Playwright, and basic understanding of AI/ML evaluation concepts. The candidate will work closely with developers, product managers, and stakeholders to ensure high-quality product delivery.
Key Responsibilities
-
Understand business requirements and create effective test scenarios and test cases.
-
Perform functional, regression, smoke, sanity, integration, and UAT testing.
-
Identify, document, track, and verify defects using defect management tools.
-
Participate actively in Agile ceremonies such as sprint planning, daily stand-ups, retrospectives, and grooming sessions.
-
Develop and maintain automation test scripts using Playwright.
-
Execute automated test suites and analyze results.
-
Collaborate with developers to troubleshoot issues and improve product quality.
-
Validate APIs and backend responses using tools like Postman or similar.
-
Perform basic AI/ML output evaluations for chatbot or LLM-based applications.
-
Prepare QA reports, test execution summaries, and quality metrics.
-
Support release validation and production sanity testing.
Required Skills
-
Manual Testing
-
Strong understanding of SDLC and STLC
-
Experience in:
-
Functional Testing
-
Regression Testing
-
Smoke/Sanity Testing
-
API Testing Basics
-
Defect Lifecycle
-
Experience with test management and bug tracking tools (JIRA, Azure DevOps, etc.)
Agile Process
-
Good understanding of Agile/Scrum methodologies
-
Experience working in sprint-based delivery models
-
Ability to collaborate effectively within cross-functional teams
Automation Testing
-
Hands-on experience with Playwright
-
Knowledge of:
-
UI automation
-
Locator strategies
-
Assertions
-
Test execution and reporting
-
Basic understanding of JavaScript/TypeScript
AI/ML Evaluation Basics
-
Basic understanding of AI chatbot and LLM response validation
-
Knowledge of:
-
Accuracy and relevancy checks
-
Hallucination identification
-
Response quality validation
-
Simple rubric-based evaluations
-
Basic understanding of RAG evaluation concepts
-
Exposure to evaluation tools/frameworks like RAGAs or similar frameworks
-
Ability to compare expected vs generated responses and report quality issues
Good to Have
-
Experience with CI/CD pipelines
-
Exposure to performance or load testing tools
-
Basic SQL knowledge
-
Exposure to GenAI or conversational AI applications
Educational Qualification
-
Bachelor’s degree in Computer Science, IT, or related field
Preferred Qualities
-
Strong analytical and problem-solving skills
-
Good communication and documentation abilities
-
Quick learner with proactive attitude
-
Attention to detail and ownership mindset
