We are seeking a skilled Integration Playwright Tester with expertise in AI chatbot testing, API and end-to-end integration testing, and Playwright automation using TypeScript. The role involves validating complex integrations across AI/LLM platforms, cloud services, APIs, databases, and downstream applications, while ensuring data consistency, backward compatibility, and quality across the Standards Assistant ecosystem.
- Gain knowledge of integrations between the Standards Assistant (SA Front End, SABeL, SAIL) and external systems (Okta CIAM, AWS Bedrock, AWS DocumentDB, OpenAI, Anthropic Claude, OpenSearch, MarkLogic, MuleSoft, Kafka, MAE/Core Services).
- Review existing test artefacts, scenarios, and identify integration test gaps across SA modules — including chat workflows, workspace management, standards discovery, and MCP Server integrations.
- Design and author integration test cases in ASTM’s test management tool (Jira + Xray).
- Automate end-to-end integration flows using Playwright (TypeScript) to ensure backward compatibility across SA and dependent ASTM applications (Compass, Membership, PIM, Public/Magento).
- Execute manual/automated integration tests and validate data consistency across SABeL APIs, SAIL AI responses, and downstream data stores (DocumentDB, PostgreSQL, Redis).
- Validate AI/LLM feature integrations — including intent classification, RAG retrieval accuracy, streaming (SSE) responses, and entitlement-based access controls.
- Report and track integration defects with detailed RCA and regression impact analysis.
- Provide daily/weekly reports highlighting integration quality, test coverage, and automation progress.
