English
Related papers

Related papers: Make LLM a Testing Expert: Bringing Human-like Int…

200 papers

Mobile apps are indispensable for people's daily life, and automated GUI (Graphical User Interface) testing is widely used for app quality assurance. There is a growing interest in using learning-based techniques for automated GUI testing…

Software Engineering · Computer Science 2023-05-17 Zhe Liu , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Xing Che , Dandan Wang , Qing Wang

In the development and maintenance of Android apps, the quick and accurate reproduction of user-reported bugs is crucial to ensure application quality and improve user satisfaction. However, this process is often time-consuming and complex.…

Software Engineering · Computer Science 2026-04-01 Xiangyang Xiao , Huaxun Huang , Rongxin Wu

Mobile applications have become an essential part of our daily lives, making ensuring their quality an important activity. Graphical User Interface (GUI) testing is a quality assurance method that has frequently been used for mobile apps.…

Software Engineering · Computer Science 2025-09-11 Chenhui Cui , Tao Li , Junjie Wang , Chunyang Chen , Dave Towey , Rubing Huang

Android apps rely heavily on Data Manipulation Functionalities (DMFs) for handling app-specific data through CRUDS operations, making their correctness vital for reliability. However, detecting Data Manipulation Errors (DMEs) is challenging…

Software Engineering · Computer Science 2026-05-12 Xiangyang Xiao , Huaxun Huang , Rongxin Wu

This paper introduces DroidBot-GPT, a tool that utilizes GPT-like large language models (LLMs) to automate the interactions with Android mobile applications. Given a natural language description of a desired task, DroidBot-GPT can…

Software Engineering · Computer Science 2024-01-09 Hao Wen , Hongming Wang , Jiaxuan Liu , Yuanchun Li

With the rapid advancement of large language models (LLMs), mobile agents have emerged as promising tools for phone automation, simulating human interactions on screens to accomplish complex tasks. However, these agents often suffer from…

Human-Computer Interaction · Computer Science 2026-04-21 Shiquan Zhang , Tianyi Zhang , Le Fang , Simon D'Alfonso , Hong Jia , Vassilis Kostakos

Mobile task automation is an attractive technique that aims to enable voice-based hands-free user interaction with smartphones. However, existing approaches suffer from poor scalability due to the limited language understanding ability and…

Artificial Intelligence · Computer Science 2024-03-12 Hao Wen , Yuanchun Li , Guohong Liu , Shanhui Zhao , Tao Yu , Toby Jia-Jun Li , Shiqi Jiang , Yunhao Liu , Yaqin Zhang , Yunxin Liu

GUI testing checks if a software system behaves as expected when users interact with its graphical interface, e.g., testing specific functionality or validating relevant use case scenarios. Currently, deciding what to test at this high…

Software Engineering · Computer Science 2023-11-16 Juyeon Yoon , Robert Feldt , Shin Yoo

As generative artificial intelligence advances, Large Language Models (LLMs) are being explored for automated graphical user interface (GUI) design. This study investigates the usability and adaptability of LLM-generated interfaces by…

Human-Computer Interaction · Computer Science 2026-02-02 Bartosz Sawicki , Tomasz Les , Dariusz Parzych , Aleksandra Wycisk-Ficek , Pawel Trebacz , Pawel Zawadzki

GUI testing is an essential quality assurance process in mobile app development. However, the creation and maintenance of GUI tests for mobile apps are resource-intensive and costly. Recognizing that many apps share similar functionalities,…

Software Engineering · Computer Science 2025-04-04 Xiaolei Li , Jialun Cao , Yepang Liu , Shing-Chi Cheung , Hailong Wang

The Graphical User Interface (GUI) is pivotal for human interaction with the digital world, enabling efficient device control and the completion of complex tasks. Recent progress in Large Language Models (LLMs) and Vision Language Models…

Artificial Intelligence · Computer Science 2024-06-14 Danyang Zhang , Zhennan Shen , Rui Xie , Situo Zhang , Tianbao Xie , Zihan Zhao , Siyuan Chen , Lu Chen , Hongshen Xu , Ruisheng Cao , Kai Yu

XML configurations are integral to the Android development framework, particularly in the realm of UI display. However, these configurations can introduce compatibility issues (bugs), resulting in divergent visual outcomes and system…

Software Engineering · Computer Science 2024-02-26 Zhijie Liu , Yutian Tang , Meiyun Li , Xin Jin , Yunfei Long , Liang Feng Zhang , Xiapu Luo

Interactive systems are omnipresent today and the need to create graphical user interfaces (GUIs) is just as ubiquitous. For the elicitation and validation of requirements, GUI prototyping is a well-known and effective technique, typically…

Software Engineering · Computer Science 2024-06-13 Kristian Kolthoff , Felix Kretzer , Christian Bartelt , Alexander Maedche , Simone Paolo Ponzetto

The integration of AI techniques has become increasingly popular in software development, enhancing performance, usability, and the availability of intelligent features. With the rise of large language models (LLMs) and generative AI,…

Software Engineering · Computer Science 2025-02-25 Kimberly Hau , Safwat Hassan , Shurui Zhou

Mobile graphical user interface (GUI) agents are designed to automate everyday tasks on smartphones. Recent advances in large language models (LLMs) have significantly enhanced the capabilities of mobile GUI agents. However, most…

Human-Computer Interaction · Computer Science 2026-01-27 Mingxian Yu , Siqi Luo , Xu Chen

Automated GUI testing is widely used to help ensure the quality of mobile apps. However, many GUIs require appropriate text inputs to proceed to the next page which remains a prominent obstacle for testing coverage. Considering the…

Software Engineering · Computer Science 2022-12-12 Zhe Liu , Chunyang Chen , Junjie Wang , Xing Che , Yuekai Huang , Jun Hu , Qing Wang

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

Random GUI testing is a widely-used technique for testing mobile apps. However, its effectiveness is limited by the notorious issue -- UI exploration tarpits, where the exploration is trapped in local UI regions, thus impeding test coverage…

Software Engineering · Computer Science 2026-04-14 Mengqian Xu , Yiheng Xiong , Le Chang , Ting Su , Chengcheng Wan , Weikai Miao

With the rapid rise of large language models (LLMs), phone automation has undergone transformative changes. This paper systematically reviews LLM-driven phone GUI agents, highlighting their evolution from script-based automation to…

Numerous approaches employing various strategies have been developed to test the graphical user interfaces (GUIs) of mobile apps. However, traditional GUI testing techniques, such as random and model-based testing, primarily focus on…

Software Engineering · Computer Science 2024-07-30 Bangyan Ju , Jin Yang , Tingting Yu , Tamerlan Abdullayev , Yuanyuan Wu , Dingbang Wang , Yu Zhao
‹ Prev 1 2 3 10 Next ›