English
Related papers

Related papers: Automated Test Generation for REST APIs: No Time t…

200 papers

The mass production of complex software has made it impossible to manually test it for security vulnerabilities. Automated security testing tools come in a variety of flavors, function at various stages of software development, and target…

Software Engineering · Computer Science 2023-01-18 Yan Wu , Jingyi Su , David D. Moran , Chris D. Near

The effective execution of tests for REST APIs remains a considerable challenge for development teams, driven by the inherent complexity of distributed systems, the multitude of possible scenarios, and the limited time available for test…

Software Engineering · Computer Science 2025-09-09 Thiago Barradas , Aline Paes , Vânia de Oliveira Neves

Application Programming Interfaces (APIs), which encapsulate the implementation of specific functions as interfaces, greatly improve the efficiency of modern software development. As numbers of APIs spring up nowadays, developers can hardly…

Software Engineering · Computer Science 2021-12-24 Yun Peng , Shuqing Li , Wenwei Gu , Yichen Li , Wenxuan Wang , Cuiyun Gao , Michael Lyu

Modern web applications rely heavily on client-side API calls to fetch data, render content, and communicate with backend services. However, the quality of these network interactions (redundant requests, missing cache headers, oversized…

Software Engineering · Computer Science 2026-02-19 Ali Hassaan Mughal , Muhammad Bilal , Noor Fatima

Tool-augmented large language models (LLMs) have achieved remarkable progress in tackling a broad range of tasks. However, existing methods are mainly restricted to specifically designed tools and fail to fulfill complex instructions,…

Computation and Language · Computer Science 2023-08-29 Yifan Song , Weimin Xiong , Dawei Zhu , Wenhao Wu , Han Qian , Mingbo Song , Hailiang Huang , Cheng Li , Ke Wang , Rong Yao , Ye Tian , Sujian Li

LLM-based tool agents offer natural language interfaces, enabling users to seamlessly interact with computing services. While REST APIs are valuable resources for building such agents, they must first be transformed into AI-compatible…

Machine Learning · Computer Science 2025-01-29 Xinyi Ni , Qiuyang Wang , Yukun Zhang , Pengyu Hong

RESTful APIs are central in developing interoperable, modular, and maintainable software systems in enterprises today. Also, it is essential to support system evolution, service interoperability, and governance across organizational…

Software Engineering · Computer Science 2025-11-25 Edwin Sundberg , Thea Ekmark , Workneh Yilma Ayele

We present AuthREST, an open-source security testing tool targeting broken authentication, one of the most prevalent API security risks in the wild. AuthREST automatically tests web APIs for credential stuffing, password brute forcing, and…

Cryptography and Security · Computer Science 2025-09-15 Davide Corradini , Mariano Ceccato , Mohammad Ghafari

Large Language Models (LLMs) are increasingly used to support software testing tasks, yet there is little evidence of their effectiveness for REST API testing in industrial settings. To address this gap, we replicate our earlier work on…

Software Engineering · Computer Science 2026-01-27 Tolgahan Bardakci , Andreas Faes , Mutlu Beyazit , Serge Demeyr

Testing RESTful API is increasingly important in quality assurance of cloud-native applications. Recent advances in machine learning (ML) techniques have demonstrated that various testing activities can be performed automatically by large…

Software Engineering · Computer Science 2025-11-25 Xiaoke Han , Hong Zhu

As REST APIs become an increasingly significant part of software systems, their validation is becoming more critical. Hence, testing and uncovering underlying issues are of utmost importance for improving software quality. However, testing…

Software Engineering · Computer Science 2026-05-28 Shehroz Khan , Abdullah Mughees , Gaadha Sudheerbabu , Tanwir Ahmad , Dragos Truscan

Large language models (LLMs) have limitations in handling tasks that require real-time access to external APIs. While several benchmarks like ToolBench and APIGen have been developed to assess LLMs' API-use capabilities, they often suffer…

Artificial Intelligence · Computer Science 2024-09-25 Woojeong Kim , Ashish Jagmohan , Aditya Vempaty

Automated testing for REST APIs has become essential for ensuring the correctness and reliability of modern web services. While existing approaches primarily focus on detecting server crashes and error codes, they often overlook logical…

Software Engineering · Computer Science 2025-03-20 Ke Zhang , Chenxi Zhang , Chong Wang , Chi Zhang , YaChen Wu , Zhenchang Xing , Yang Liu , Qingshan Li , Xin Peng

Automated software testing has significant potential to enhance efficiency and reliability within software development processes. However, its broader adoption faces considerable challenges, particularly concerning alignment between test…

Software Engineering · Computer Science 2025-08-26 Fanyu Wang , Chetan Arora , Chakkrit Tantithamthavorn , Kaicheng Huang , Aldeida Aleti

Large language models (LLMs) increasingly rely on external tools and APIs to execute complex tasks specified in natural language. Evaluating such tool calling capabilities in realistic enterprise settings is challenging: APIs are often…

Software Engineering · Computer Science 2026-01-27 Benjamin Elder , Anupama Murthi , Jungkoo Kang , Ankita Rajaram Naik , Kiran Kate , Kinjal Basu , Danish Contractor

With this paper, we introduce RESTifAI, an LLM-driven approach for generating reusable, CI/CD ready REST API tests, following the happy-path approach. Unlike existing tools that often focus primarily on internal server errors, RESTifAI…

Software Engineering · Computer Science 2025-12-10 Leon Kogler , Maximilian Ehrhart , Benedikt Dornauer , Eduard Paul Enoiu

Existing REST API testing tools are typically evaluated using code coverage and crash-based fault metrics. However, recent LLM-based approaches increasingly generate tests from NL requirements to validate functional behaviour, making…

Software Engineering · Computer Science 2026-04-29 Leon Kogler , Stefan Hangler , Maximilian Ehrhart , Benedikt Dornauer , Roland Wuersching , Peter Schrammel

Software developers study and reuse existing source code to understand how to properly use application programming interfaces (APIs). However, manually finding sufficient and adequate code examples for a given API is a difficult and a…

Software Engineering · Computer Science 2022-08-02 Mohammad Ghafari , Konstantin Rubinov , Mohammad Mehdi Pourhashem K

Application Programming Interfaces (APIs) are designed to help developers build software more effectively. Recommending the right APIs for specific tasks has gained increasing attention among researchers and developers in recent years. To…

Information Retrieval · Computer Science 2024-01-30 Moshi Wei , Nima Shiri Harzevili , Alvine Boaye Belle , Junjie Wang , Lin Shi , Jinqiu Yang , Song Wang , Ming Zhen , Jiang

REST API test case generation tools are evolving rapidly, with growing capabilities for the automated generation of complex tests. However, despite their strengths in test data generation, these tools are constrained by the types of test…

Software Engineering · Computer Science 2025-09-03 Juan C. Alonso , Alberto Martin-Lopez , Sergio Segura , Gabriele Bavota , Antonio Ruiz-Cortés