English
Related papers

Related papers: GUI Test Migration via Abstraction and Concretizat…

200 papers

Graphical User Interface (GUI) tasks are vital for automating workflows such as software testing, user interface navigation. For users, the GUI is the most intuitive platform for interacting with a computer. Previous work identified a key…

Computation and Language · Computer Science 2025-03-10 Zheng Hui , Yinheng Li , Dan zhao , Tianyi Chen , Colby Banbury , Kazuhito Koishida

Machine learning (ML) in real-world systems must contend with concept drift, adversarial actors, and a spectrum of potential features with varying costs and benefits. Malware naturally exhibits all of these complexities, but for the same…

Mutation testing is the state-of-the-art technique for assessing the fault-detection capacity of a test suite. Unfortunately, mutation testing consumes enormous computing resources because it runs the whole test suite for each and every…

Software Engineering · Computer Science 2018-10-10 Sten Vercammen , Mohammad Ghafari , Serge Demeyer , Markus Borg

GUI task automation streamlines repetitive tasks, but existing LLM or VLM-based planner-executor agents suffer from brittle generalization, high latency, and limited long-horizon coherence. Their reliance on single-shot reasoning or static…

Artificial Intelligence · Computer Science 2025-09-29 Seoyoung Lee , Seonbin Yoon , Seongbeen Lee , Hyesoo Kim , Joo Yong Sim

(M)LLM-powered computer use agents (CUA) are emerging as a transformative technique to automate human-computer interaction. However, existing CUA benchmarks predominantly target GUI agents, whose evaluation methods are susceptible to UI…

The ability to verify research results and to experiment with methodologies are core tenets of science. As research results are increasingly the outcome of computational processes, software plays a central role. GNU Guix is a software…

Software Engineering · Computer Science 2024-05-27 Ludovic Courtès , Timothy Sample , Simon Tournier , Stefano Zacchiroli

Major data centre providers are introducing RDMA-based networks for their tenants, as well as for operating the underlying infrastructure. In comparison to traditional socket-based network stacks, RDMA-based networks offer higher…

Operating Systems · Computer Science 2020-10-26 Maksym Planeta , Jan Bierbaum , Leo Sahaya Daphne Antony , Torsten Hoefler , Hermann Härtig

Recent popularity of Large Language Models (LLMs) has opened countless possibilities in automating numerous AI tasks by connecting LLMs to various domain-specific models or APIs, where LLMs serve as dispatchers while domain-specific models…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Zhizheng Zhang , Wenxuan Xie , Xiaoyi Zhang , Yan Lu

Mutation testing may be used to guide test case generation and as a technique to assess the quality of test suites. Despite being used frequently, mutation testing is not so commonly applied in the mobile world. One critical challenge in…

Task load detection is essential for optimizing human performance across diverse applications, yet current models often lack generalizability beyond narrow experimental domains. While prior research has focused on individual tasks and…

Machine Learning · Computer Science 2025-09-03 Maximilian P. Oppelt , Andreas Foltyn , Nadine R. Lang-Richter , Bjoern M. Eskofier

Library migration is a challenging problem, where most existing approaches rely on prior knowledge. This can be, for example, information derived from changelogs or statistical models of API usage. This paper addresses a different API…

Software Engineering · Computer Science 2020-08-28 Bruce Collie , Philip Ginsbach , Jackson Woodruff , Ajitha Rajan , Michael O'Boyle

Automatic test generation can help verify and develop the behavior of mobile applications. Test reuse based on semantic similarities between applications of the same category has been utilized to reduce the manual effort of Graphical User…

Software Engineering · Computer Science 2023-01-03 Shuqi Liu , Yu Zhou , Tingting Han , Taolue Chen

Web Applications (WA's) failures may lead to collapse of the institutions, therefore the importance of good quality WA's is increasing over the time. Testing is one of the best quality metrics that decide whether WA's are reliable or not.…

Software Engineering · Computer Science 2012-05-31 Mostafa Kandil , Ehab Hassanein , Sherif Mazen

Graphical user interface (GUI) grounding, the ability to map natural language instructions to specific actions on graphical user interfaces, remains a critical bottleneck in computer use agent development. Current benchmarks oversimplify…

Mobile applications have become an essential part of our daily lives, making ensuring their quality an important activity. Graphical User Interface (GUI) testing is a quality assurance method that has frequently been used for mobile apps.…

Software Engineering · Computer Science 2025-09-11 Chenhui Cui , Tao Li , Junjie Wang , Chunyang Chen , Dave Towey , Rubing Huang

Domain-specific accelerators are used in various computing systems ranging from edge devices to data centers. Coarse-grained reconfigurable arrays (CGRAs) represent an architectural midpoint between the flexibility of an FPGA and the…

Hardware Architecture · Computer Science 2023-01-04 Taeyoung Kong , Kalhan Koul , Priyanka Raina , Mark Horowitz , Christopher Torng

Graphical User Interface (GUI) agents extend large language models from text generation to action execution in real-world digital environments. Unlike conversational systems, GUI agents perform irreversible operations such as submitting…

Machine Learning · Computer Science 2026-02-25 Yucheng Shi , Wenhao Yu , Jingyuan Huang , Wenlin Yao , Wenhu Chen , Ninghao Liu

Grounding is a fundamental capability for building graphical user interface (GUI) agents. Although existing approaches rely on large-scale bounding box supervision, they still face various challenges, such as cross-platform generalization,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Zhiyuan Jiang , Shenghao Xie , Wenyi Li , Wenqiang Zu , Peihang Li , Jiahao Qiu , Siqi Pei , Lei Ma , Tiejun Huang , Mengdi Wang , Shilong Liu

Developers heavily rely on Application Programming Interfaces (APIs) from libraries to build their software. As software evolves, developers may need to replace the used libraries with alternate libraries, a process known as library…

Software Engineering · Computer Science 2024-02-01 Mohayeminul Islam , Ajay Kumar Jha , Ildar Akhmetov , Sarah Nadi

Graphical user interfaces (GUIs), due to their event driven nature, present a potentially unbounded space of all possible ways to interact with software. During testing it becomes necessary to effectively sample this space. In this paper we…

Software Engineering · Computer Science 2012-05-23 Stephan Arlt , Ishan Banerjee , Cristiano Bertolini , Atif M. Memon , Martin Schäf