English
Related papers

Related papers: GUI Test Migration via Abstraction and Concretizat…

200 papers

The assurance of mobile app GUI has become increasingly important, as the GUI serves as the primary medium of interaction between users and apps. Although numerous automated GUI testing approaches have been developed with diverse…

Software Engineering · Computer Science 2026-05-05 Shengcheng Yu , Yuchen Ling , Chunrong Fang , Quan Zhou , Yi Zhao , Chunyang Chen , Shaomin Zhu , Zhenyu Chen

Software applications have been playing an increasingly important role in various aspects of society. In particular, mobile apps and web apps are the most prevalent among all applications and are widely used in various industries as well as…

Software Engineering · Computer Science 2024-06-13 Shengcheng Yu , Chunrong Fang , Xin Li , Yuchen Ling , Zhenyu Chen , Zhendong Su

The Graphical User Interface (GUI) is how users interact with mobile apps. To ensure it functions properly, testing engineers have to make sure it functions as intended, based on test requirements that are typically written in natural…

Software Engineering · Computer Science 2024-07-15 Yongxiang Hu , Xuan Wang , Yingchuan Wang , Yu Zhang , Shiyu Guo , Chaoyi Chen , Xin Wang , Yangfan Zhou

The inception of a mobile app often takes form of a mock-up of the Graphical User Interface (GUI), represented as a static image delineating the proper layout and style of GUI widgets that satisfy requirements. Following this initial…

Software Engineering · Computer Science 2018-04-09 Kevin Moran , Boyang Li , Carlos Bernal-Cárdenas , Dan Jelf , Denys Poshyvanyk

Test cases are essential for software development and maintenance. In practice, developers derive multiple test cases from an implicit pattern based on their understanding of requirements and inference of diverse test scenarios, each…

Software Engineering · Computer Science 2026-04-28 Binhang Qi , Yun Lin , Xinyi Weng , Chenyan Liu , Hailong Sun , Gordon Fraser , Jin Song Dong

Multimodal large language models (MLLMs) have markedly expanded the competence of graphical user-interface (GUI) systems, propelling them beyond controlled simulations into complex, real-world environments across diverse platforms. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Bin Lei , Nuo Xu , Ali Payani , Mingyi Hong , Chunhua Liao , Yu Cao , Caiwen Ding

Automated GUI testing is widely used to help ensure the quality of mobile apps. However, many GUIs require appropriate text inputs to proceed to the next page which remains a prominent obstacle for testing coverage. Considering the…

Software Engineering · Computer Science 2022-12-12 Zhe Liu , Chunyang Chen , Junjie Wang , Xing Che , Yuekai Huang , Jun Hu , Qing Wang

Recent Graphical User Interface (GUI) agents replicate the R1-Zero paradigm, coupling online Reinforcement Learning (RL) with explicit chain-of-thought reasoning prior to object grounding and thereby achieving substantial performance gains.…

Computation and Language · Computer Science 2025-05-23 Yuqi Zhou , Sunhao Dai , Shuai Wang , Kaiwen Zhou , Qinglin Jia , Jun Xu

The importance of mobile application (app) quality insurance is increasing with the rapid development of the mobile Internet. Automated test generation approaches, as a dominant direction of app quality insurance, follow specific models or…

Software Engineering · Computer Science 2024-06-13 Shengcheng Yu , Chunrong Fang , Mingzhe Du , Zimin Ding , Zhenyu Chen , Zhendong Su

Cloud, fog, and edge computing integration with future mobile Internet-of-Things (IoT) devices and related applications in 5G/6G networks will become more practical in the coming years. Containers became the de facto virtualization…

Networking and Internet Architecture · Computer Science 2023-05-19 Arshin Rezazadeh , Hanan Lutfiyya

Graphical User Interface (GUI) action grounding is a critical step in GUI automation that maps language instructions to actionable elements on GUI screens. Most recent works of GUI action grounding leverage large GUI datasets to fine-tune…

Computation and Language · Computer Science 2025-01-28 Yue Fan , Handong Zhao , Ruiyi Zhang , Yu Shen , Xin Eric Wang , Gang Wu

Graphical User Interfaces (GUIs) are central to app development projects. App developers may use the GUIs of other apps as a means of requirements refinement and rapid prototyping or as a source of inspiration for designing and improving…

Software Engineering · Computer Science 2024-11-12 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Binbin Xu , Pierre Louis Bernard , Gérard Dray , Walid Maalej

Multimodal large language models (MLLMs) are transforming the capabilities of graphical user interface (GUI) agents, facilitating their transition from controlled simulations to complex, real-world applications across various platforms.…

Artificial Intelligence · Computer Science 2025-06-18 Boyu Gou , Ruohan Wang , Boyuan Zheng , Yanan Xie , Cheng Chang , Yiheng Shu , Huan Sun , Yu Su

The rapid development of GUI foundation models and mobile GUI agents has spurred numerous evaluation benchmarks, yet most rely on simulated environments or open-source applications, leaving real-world closed-source applications largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yifan Sui , Xin Huang , Hongbing Li , Fang Xu , Jiahe Lv , Haolong Yan , Yeqing Shen , Litao Liu , Zhimin Fan , Ziyang Meng , Jia Wang , Junbo Qi , Kaijun Tan , Zheng Ge , Xiangyu Zhang , Daxin Jiang , Osamu Yoshie

The software industry aims to provide customers with quality software. Testing software is a critical and sensitive stage in ensuring software quality. Due to the increasing popularity of mobile devices, the use of Android applications has…

Software Engineering · Computer Science 2022-09-07 Fatemeh Mosayeb , Shohreh Ajoudanian

Continuous Integration (CI) is a widely adopted practice for faster code change integration and testing. Developers often migrate between CI systems in pursuit of features like matrix building or better logging. However, this migration is…

Software Engineering · Computer Science 2024-07-04 Dhia Elhaq Rzig , Alaa Houerbi , Chungha Sung , Foyzul Hassan

Abstraction (in its various forms) is a powerful established technique in model-checking; still, when unbounded data-structures are concerned, it cannot always cope with divergence phenomena in a satisfactory way. Acceleration is an…

Logic in Computer Science · Computer Science 2013-10-04 Francesco Alberti , Silvio Ghilardi , Natasha Sharygina

Context: Visual GUI testing (VGT) is referred to as the latest generation GUI-based testing. It is a tool-driven technique, which uses image recognition for interacting with and asserting the behavior of the system under test. Motivated by…

Recent advances in Multimodal Large Language Models (MLLMs) have enabled autonomous agents to interact with computers via Graphical User Interfaces (GUIs), where accurately localizing the coordinates of interface elements (e.g., buttons) is…

Machine Learning · Computer Science 2025-05-27 Hyunseok Lee , Jeonghoon Kim , Beomjun Kim , Jihoon Tack , Chansong Jo , Jaehong Lee , Cheonbok Park , Sookyo In , Jinwoo Shin , Kang Min Yoo

GUI-based models extracted from Android app execution traces, events, or source code can be extremely useful for challenging tasks such as the generation of scenarios or test cases. However, extracting effective models can be an expensive…

Software Engineering · Computer Science 2018-01-22 Mario Linares-Vasquez , Martin White , Carlos Bernal-Cardenas , Kevin Moran , Denys Poshyvanyk