Job Description:
About ETS:
ETS is a global education and talent solutions organization enabling lifelong learners worldwide to be future-ready. For more than 75 years, we've been advancing the science of measurement to build benchmarks for fair and valid skill assessment across cultures and borders. Our worldwide impact extends through our renowned assessments including TOEFL®, TOEIC®, GRE® and Praxis® tests, serving millions of learners in more than 200 countries and territories. Through strategic acquisitions, we've expanded our global capabilities: PSI strengthens our workforce assessment solutions, while Edusoft, Kira Talent, Pipplet, Vericant, and Wheebox enhance our educational technology and assessment platforms across critical markets worldwide.
Through ETS Research Institute and ETS Solutions, we're partnering with educational institutions, governments, and organizations globally to promote skill proficiency, empower upward mobility, and unlock opportunities for everyone, everywhere. With offices and partners across Asia, Europe, the Middle East, Africa, and the Americas, we deliver nearly 50 million tests annually. Join us in our journey of measuring progress to power human progress worldwide.
Position Summary
The Staff Agentic AI Engineer - Quality Automation Platform & Modernization is responsible for designing, developing, and maintaining agentic AI workflows that transform enterprise quality artifacts into reviewable, traceable, executable quality automation assets. This role is a senior hands-on engineering position within the AI Quality Automation Transformation CoE and focuses on building the agentic workflow layer, reusable prompt patterns, tool integrations, automation generation logic, and modernization pathways for existing automation assets.
The role develops workflows that ingest data and artifacts from systems such as Jira, GitLab, Confluence, Figma, and Zephyr; process that context through specialized AI agents; and generate automation scripts and executions.
This role also supports modernization of the existing automation estate. New AI-first workflows must be designed with awareness of current conventional automation frameworks including functional and performance testing, pipeline execution, and regression-maintenance dependencies. The role helps classify existing automation assets for reuse, refactoring, regeneration, migration, or retirement while protecting current regression capability.
Primary Responsibilities
- Design, build, and maintain AI agentic workflows for quality automation, including ingestion, context refinement, scenario generation, script generation, review, and repository integration.
- Develop and maintain AI agents for quality engineering use cases, including Jira issue analysis, Zephyr test case ingestion, Confluence/Figma context retrieval, GitLab script generation, code refactoring, and automation output validation.
- Build reusable prompt libraries, workflow templates, agent instructions, and validation patterns for positive, negative, edge, regression, PPV, integration, performance and E2E scenarios.
- Generate or support generation of automation scripts and quality assets using Playwright/JavaScript and other approved automation technologies.
- Develop transition patterns that allow existing automation frameworks and solutions, and manual regression assets to be analyzed, reused, refactored, regenerated, or retired.
- Partner with the Principal AI Quality Architect to implement architecture standards, governance requirements, and reusable design patterns.
- Integrate agentic workflows with enterprise tools and repositories, including Jira, Zephyr, GitLab, Confluence, Figma, and future approved sources.
- Support comparison of AI-generated automation outputs against existing automation baselines, including effort, traceability, stability, maintenance, and execution readiness.
- Collaborate with SQA domain teams across UI, API, DB, AWS/cloud, desktop, performance, security, accessibility, functional integration, and E2E testing to identify high-value automation candidates.
- Document workflow designs, prompt patterns, integration assumptions, known limitations, operating instructions, and reusable implementation guidance.
#LI-AD1
Experience and Skills:
- Strong software engineering skills with Python and/or JavaScript/TypeScript.
- Hands-on experience of Performance Testing across multiple technologies including Cloud Native, Serverless, Client Server, SalesForce stacks.
- Hands-on experience with automation frameworks such as Playwright, Selenium, or comparable test automation technologies.
- Working knowledge of REST APIs, OpenAPI specifications, Git-based workflows, repository automation, and CI/CD integration patterns.
- Practical experience with LLMs, prompt engineering, RAG/context retrieval patterns, agentic workflows, or AI-assisted software engineering.
- Experience integrating with Jira, Zephyr, GitLab, Confluence, Figma, or similar enterprise engineering systems.
- Ability to analyze existing test cases, requirements, defects, scripts, logs, and automation outputs to identify reusable context and modernization paths.
- Strong understanding of quality engineering across functional, regression, integration, API, database, accessibility, security, performance, and E2E testing.
- Ability to design agent outputs that are reviewable, traceable, maintainable, and suitable for human-in-the-loop validation.
- Strong troubleshooting skills for prompt behavior, generated-code quality, workflow failures, tool-integration errors, and automation execution issues.
Education and Experience
Required
- Bachelor's degree in Computer Science, Engineering, Information Technology, Information Systems, or equivalent practical experience.
- 2+ years of experience in Agentic AI engineering and development for quality engineering
- 5+ years of experience in performance testing and engineering, test automation engineering, SDET, quality engineering, or platform development.
- Demonstrated experience building automation frameworks, integrating tools through APIs, or developing reusable engineering workflows.
- Experience with Git-based development, CI/CD pipelines, code review, and automated test execution.
Preferred
- Hands-on experience with MCP-style tool integration, or comparable agentic AI platforms.
- Experience with AI-assisted test generation, script generation, defect/log summarization, or requirements-to-test traceability.
- Experience with JMETER, CloudTest, AIQ/Appvance, Selenium/Fusion, Playwright, GitLab CI/CD, Zephyr, Jira, Confluence, AWS/cloud environments, or similar tooling.
- Experience modernizing legacy automation assets or supporting automation migration across platforms.
- Experience in enterprise or regulated environments where traceability, evidence, auditability, privacy, and security are important.
ETS is mission driven and action oriented
-
We are passionate about hiring innovative thinkers who believe in the promise of education and lifelong learning.
- We are energized by cultivating growth, innovation, and continuous transformation for the next generation of rising professionals as leaders. Â In support of this ETS offers multiple Business Resource Groups (BRG) for you to learn and advance your career growth!
- As a not-for-profit organization we will encourage you to lean in to your passion for volunteering. Â At ETS you may qualify for up to an additional 8 hours of PTO for volunteer work on causes that are important to you!
- The base salary range advertised represents the low and high end of the anticipated salary range for this position. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. The base pay is only one aspect of the Total Rewards Package that will be offered to the successful candidate.
ETS is an Equal Opportunity Employer. We are committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, marital status, veteran status, sexual orientation, gender identity, or any other characteristic protected by law. We believe in creating a work environment where all individuals are treated with respect and dignity.
From: ETS GCC
