We are seeking an experienced Software Tester to join our dynamic team. The ideal candidate will have a minimum of three years of experience in software testing, with a strong focus on Large Language Model (LLM) evaluation, test case writing, and quality assurance practices. This role is crucial in ensuring the reliability and performance of our software products before they reach our users.
Key Responsibilities:
- Collaborate with cross-functional teams, including developers and project managers, to understand project requirements and scope.
- Design, develop, and execute comprehensive test cases for LLM applications, ensuring alignment with business objectives and user needs.
- Conduct various types of testing including functional, regression, performance, and usability testing to identify defects and ensure high-quality outputs.
- Implement both manual and automated testing strategies to validate software functionality.
- Write detailed bug reports and documentation to communicate findings effectively to development teams.
- Participate in the development of test plans and strategies tailored for LLM applications, addressing unique challenges such as output variability.
- Utilize testing tools and frameworks to enhance efficiency in the testing process.
- Provide objective feedback on software quality and performance, assisting in troubleshooting and problem resolution.
- Stay updated with industry trends in software testing methodologies, particularly in AI and machine learning contexts.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field is preferred.
- At least three years of relevant experience in testing.
- Proven experience with LLM evaluation techniques and methodologies for assessing AI-generated outputs.
- Strong analytical skills with a keen eye for detail to identify issues effectively.
- Familiarity with test management software (e.g., Jira, selenium)
- Excellent communication skills to articulate findings clearly to both technical and non-technical stakeholders.
- Ability to work independently as well as collaboratively within a team environment.
