AutoRestTest at the SBFT 2026 Tool Competition
Software Engineering
2026-07-01 v1
Abstract
Large input spaces and complex inter-operation dependencies make black-box REST API testing challenging. AutoRestTest combines a Semantic Property Dependency Graph, multi-agent reinforcement learning, and large language models to intelligently explore large API input spaces. In the SBFT 2026 REST League, AutoRestTest ranked first in all three evaluation categories -- fault detection, overall efficiency, and overall effectiveness -- on 11 APIs (317 operations, approximately 29 per API), averaging 67.09 unique server errors and 17.27 successfully processed operations per API under a one-hour testing budget.
Cite
@article{arxiv.2607.01063,
title = {AutoRestTest at the SBFT 2026 Tool Competition},
author = {Tyler Stennett and Myeongsoo Kim and Saurabh Sinha and Alessandro Orso},
journal= {arXiv preprint arXiv:2607.01063},
year = {2026}
}
Comments
2 pages, 1 figure. Published in the 19th Search-Based and Fuzz Testing Workshop (SBFT '26), co-located with ICSE 2026