English
Related papers

Related papers: GLIB: Towards Automated Test Oracle for Graphicall…

200 papers

Oracles used for testing graphical user interface (GUI) programs are required to take into consideration complicating factors such as variations in screen resolution or color scheme when comparing observed GUI elements to expected GUI…

Software Engineering · Computer Science 2016-11-18 Dalal Hammoud , Fadi A. Zaraket , Wes Masri

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the development of technology and aesthetics, the visual effects of the GUI are more…

Software Engineering · Computer Science 2020-09-08 Zhe Liu , Chunyang Chen , Junjie Wang , Yuekai Huang , Jun Hu , Qing Wang

Automated Graphical User Interface (GUI) testing plays a crucial role in ensuring app quality, especially as mobile applications have become an integral part of our daily lives. Despite the growing popularity of learning-based techniques in…

Software Engineering · Computer Science 2023-10-25 Zhe Liu , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Xing Che , Dandan Wang , Qing Wang

Mobile apps are indispensable for people's daily life, and automated GUI (Graphical User Interface) testing is widely used for app quality assurance. There is a growing interest in using learning-based techniques for automated GUI testing…

Software Engineering · Computer Science 2023-05-17 Zhe Liu , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Xing Che , Dandan Wang , Qing Wang

Mobile app GUI (Graphical User Interface) pages now contain rich visual information, with the visual semantics of each page helping users understand the application logic. However, these complex visual and functional logic present new…

Software Engineering · Computer Science 2024-12-05 Zhe Liu , Cheng Li , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Yawen Wang , Jun Hu , Qing Wang

Software testing is a crucial phase in software development, enabling the detection of issues and defects that may arise during the development process. Addressing these issues enhances software applications' quality, reliability, user…

Software Engineering · Computer Science 2024-03-18 Giacomo Garaccione , Tommaso Fulcini , Paolo Stefanut Bodnarescul , Riccardo Coppola , Luca Ardito

The HTML5 <canvas> is used to display high quality graphics in web applications such as web games (i.e., <canvas> games). However, automatically testing <canvas> games is not possible with existing web testing techniques and tools, and…

Software Engineering · Computer Science 2022-08-05 Finlay Macklon , Mohammad Reza Taesiri , Markos Viggiato , Stefan Antoszko , Natalia Romanova , Dale Paas , Cor-Paul Bezemer

Open-ended video game glitch detection aims to identify glitches in gameplay videos, describe them in natural language, and localize when they occur. Unlike conventional game glitch understanding tasks which have largely been framed as…

Multiagent Systems · Computer Science 2026-04-27 Muyang Zheng , Tong Zhou , Geyang Wu , Zihao Lin , Haibo Wang , Lifu Huang

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the upgrading of mobile devices and the development of aesthetics, the visual…

Software Engineering · Computer Science 2022-05-30 Zhe Liu , Chunyang Chen , Junjie Wang , Yuekai Huang , Jun Hu , Qing Wang

Large language models (LLMs) have achieved strong results in code generation, but their ability to generate GUI applications, especially games, remains insufficiently studied. Existing benchmarks mainly evaluate correctness through test…

Software Engineering · Computer Science 2026-04-22 Zhiyuan Peng , Wei Tao , Xin Yin , Chenhao Ying , Yuan Luo , Yiwen Guo

Exploratory GUI testing is essential for software quality but suffers from high manual costs. While Multi-modal Large Language Model (MLLM) agents excel in navigation, they fail to autonomously discover defects due to two core challenges:…

Artificial Intelligence · Computer Science 2026-01-09 Yifei Gao , Jiang Wu , Xiaoyi Chen , Yifan Yang , Zhe Cui , Tianyi Ma , Jiaming Zhang , Jitao Sang

Context. The game industry is increasingly growing in recent years. Every day, millions of people play video games, not only as a hobby, but also for professional competitions (e.g., e-sports or speed-running) or for making business by…

Software Engineering · Computer Science 2022-04-11 Emanuela Guglielmi , Simone Scalabrino , Gabriele Bavota , Rocco Oliveto

Numerous approaches employing various strategies have been developed to test the graphical user interfaces (GUIs) of mobile apps. However, traditional GUI testing techniques, such as random and model-based testing, primarily focus on…

Software Engineering · Computer Science 2024-07-30 Bangyan Ju , Jin Yang , Tingting Yu , Tamerlan Abdullayev , Yuanyuan Wu , Dingbang Wang , Yu Zhao

Exploratory GUI testing is a particularly demanding setting for MLLM agents: without predefined test scripts, an agent must autonomously navigate an application and discover defects through its own interaction. However, current evaluation…

Software Engineering · Computer Science 2026-05-29 Xiaoyi Chen , Yifei Gao , Yang Xu , Xingxing Song , Yi Zhang , Jitao Sang

Token-inconsistency bugs (TIBs) involve the misuse of syntactically valid yet incorrect code tokens, such as misused variables and erroneous function invocations, which can often lead to software bugs. Unlike simple syntactic bugs, TIBs…

Cryptography and Security · Computer Science 2025-10-14 Hongbo Chen , Yifan Zhang , Xing Han , Tianhao Mao , Huanyao Rong , Yuheng Zhang , XiaoFeng Wang , Luyi Xing , Xun Chen , Hang Zhang

Graphical user interfaces (GUIs) are integral parts of software systems that require interactions from their users. Software testers have paid special attention to GUI testing in the last decade, and have devised techniques that are…

Software Engineering · Computer Science 2017-03-29 Valéria Lelli , Arnaud Blouin , Benoit Baudry

One important step in software development is testing the finished product with actual users. These tests aim, among other goals, at determining unintuitive behavior of the software as it is presented to the end-user. Moreover, they aim to…

Software Engineering · Computer Science 2025-05-26 Tim Rosenbach , David Heidrich , Alexander Weinert

Ensuring the correct visual appearance of graphical user interfaces (GUIs) is important because visual bugs can cause substantial losses for businesses. An application might behave functionally correct in an automated test, but visual bugs…

Software Engineering · Computer Science 2020-07-22 Daniel Kraus , Jeremias Rößler , Martin Sulzmann

Large multimodal models (LMMs) have evolved from large language models (LLMs) to integrate multiple input modalities, such as visual inputs. This integration augments the capacity of LLMs for tasks requiring visual comprehension and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Mohammad Reza Taesiri , Tianjun Feng , Anh Nguyen , Cor-Paul Bezemer

Game-like programs have become increasingly popular in many software engineering domains such as mobile apps, web applications, or programming education. However, creating tests for programs that have the purpose of challenging human…

Software Engineering · Computer Science 2022-08-30 Patric Feldmeier , Gordon Fraser
‹ Prev 1 2 3 10 Next ›