English
Related papers

Related papers: GLIB: Towards Automated Test Oracle for Graphicall…

200 papers

Graphical user interface (GUI) agents autonomously complete tasks across platforms (\eg, Linux) by sequentially decomposing user instructions into action proposals that iteratively interact with visual elements in the evolving environment.…

Gamification is an emerging technique to enhance motivation and performance in traditionally unengaging tasks like software testing. Previous studies have indicated that gamified systems have the potential to improve software testing…

Software Engineering · Computer Science 2025-04-29 Philipp Straubinger , Tommaso Fulcini , Giacomo Garaccione , Luca Ardito , Gordon Fraser

We present a new method of automatic critical mechanic discovery for video games using a combination of game description parsing and playtrace information. This method is applied to several games within the General Video Game Artificial…

Artificial Intelligence · Computer Science 2020-09-16 Michael Cerny Green , Ahmed Khalifa , Gabriella A. B. Barros , Tiago Machado , Julian Togelius

Glitch tokens, inputs that trigger unpredictable or anomalous behavior in Large Language Models (LLMs), pose significant challenges to model reliability and safety. Existing detection methods primarily rely on heuristic embedding patterns…

Artificial Intelligence · Computer Science 2025-11-11 Zihui Wu , Haichang Gao , Ping Wang , Shudong Zhang , Zhaoxiang Liu , Shiguo Lian

The process of developing a mobile application typically starts with the ideation and conceptualization of its user interface. This concept is then translated into a set of mock-ups to help determine how well the user interface embodies the…

Software Engineering · Computer Science 2019-01-07 Carlos Bernal-Cardenas , Kevin Moran , Michele Tufano , Zichang Liu , Linyong Nan , Zhehan Shi , Denys Poshyvanyk

In recent years, Multimodal Large Language Models (MLLMs) have been extensively utilized for multimodal reasoning tasks, including Graphical User Interface (GUI) automation. Unlike general offline multimodal tasks, GUI automation is…

Artificial Intelligence · Computer Science 2025-11-18 Yuyang Wanyan , Xi Zhang , Haiyang Xu , Haowei Liu , Junyang Wang , Jiabo Ye , Yutong Kou , Ming Yan , Fei Huang , Xiaoshan Yang , Weiming Dong , Changsheng Xu

Manual development of automatic tests for embedded C software is a strenuous and time-consuming task that does not scale well. With the accelerating pace of software release cycles, verification increasingly becomes the bottleneck in the…

Software Engineering · Computer Science 2026-03-11 Maximilian Harnot , Sebastian Komarnicki , Michal Polok , Timo Oksanen

Evaluating Large Language Models (LLMs) with respect to real-world code complexity is essential. Otherwise, there is a risk of overestimating LLMs' programming abilities based on simplistic benchmarks, only to be disappointed when using…

Software Engineering · Computer Science 2026-02-24 Yang Chen , Shuyang Liu , Reyhaneh Jabbarvand

Hardware-in-the-Loop (HIL) testing is essential for automotive validation but suffers from fragmented and underutilized test artifacts. This paper presents HIL-GPT, a retrieval-augmented generation (RAG) system integrating domain-adapted…

Computation and Language · Computer Science 2025-12-01 Chao Feng , Zihan Liu , Siddhant Gupta , Gongpei Cui , Jan von der Assen , Burkhard Stiller

Video-game projects are notorious for having day-one bugs, no matter how big their budget or team size. The quality of a game is essential for its success. This quality could be assessed and ensured through testing. However, to the best of…

Software Engineering · Computer Science 2021-03-12 Cristiano Politowski , Fabio Petrillo , Yann-Gäel Guéhéneuc

The rise of graph analytics platforms has led to the development of various benchmarks for evaluating and comparing platform performance. However, existing benchmarks often fall short of fully assessing performance due to limitations in…

Databases · Computer Science 2026-01-06 Lingkai Meng , Yu Shao , Long Yuan , Longbin Lai , Peng Cheng , Xue Li , Wenyuan Yu , Wenjie Zhang , Xuemin Lin , Jingren Zhou

Large language models (LLMs) excel at implementing code from functionality descriptions but struggle with algorithmic problems that require not only implementation but also identification of the suitable algorithm. Moreover, LLM-generated…

Computation and Language · Computer Science 2023-12-11 Kexun Zhang , Danqing Wang , Jingtao Xia , William Yang Wang , Lei Li

The software industry aims to provide customers with quality software. Testing software is a critical and sensitive stage in ensuring software quality. Due to the increasing popularity of mobile devices, the use of Android applications has…

Software Engineering · Computer Science 2022-09-07 Fatemeh Mosayeb , Shohreh Ajoudanian

GUI agents powered by LLMs show promise in interacting with diverse digital environments. Among these, video games offer a valuable testbed due to their varied interfaces, with adventure games posing additional challenges through complex,…

Artificial Intelligence · Computer Science 2025-10-16 Jaewoo Ahn , Junseo Kim , Heeseung Yun , Jaehyeon Son , Dongmin Park , Jaewoong Cho , Gunhee Kim

Visual script languages with a node-based interface have commonly been used in the video game industry. We examined the bug database obtained in the development of FINAL FANTASY XV (FFXV), and noticed that several types of bugs were caused…

Software Engineering · Computer Science 2022-01-04 Isamu Hasegawa , Tomoyuki Yokogawa

As applications grow in capability, they also grow in complexity. This complexity in turn gets pushed into modules and libraries. In addition, hardware configurations become increasingly elaborate, too. These two trends make understanding,…

Software Engineering · Computer Science 2018-03-21 Ronny Brendel , Bert Wesarg , Ronny Tschüter , Matthias Weber , Thomas Ilsche , Sebastian Oeste

Multimodal large language models (MLLMs) have markedly expanded the competence of graphical user-interface (GUI) systems, propelling them beyond controlled simulations into complex, real-world environments across diverse platforms. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Bin Lei , Nuo Xu , Ali Payani , Mingyi Hong , Chunhua Liao , Yu Cao , Caiwen Ding

Code contains security and functional bugs. The process of identifying and localizing them is difficult and relies on human labor. In this work, we present a novel approach (FLAG) to assist human debuggers. FLAG is based on the lexical…

Cryptography and Security · Computer Science 2023-06-23 Baleegh Ahmad , Benjamin Tan , Ramesh Karri , Hammond Pearce

Android Apps are frequently updated, every couple of weeks, to keep up with changing user, hardware and business demands. Correctness of App updates is checked through extensive testing. Recent research has proposed tools for automated GUI…

Software Engineering · Computer Science 2020-11-25 Chao Peng , Ajitha Rajan

As quantum computing is becoming increasingly popular, the underlying quantum computing platforms are growing both in ability and complexity. Unfortunately, testing these platforms is challenging due to the relatively small number of…

Software Engineering · Computer Science 2023-10-17 Matteo Paltenghi , Michael Pradel