English
Related papers

Related papers: Visual Testing of GUIs by Abstraction

200 papers

Automotive user interface (AUI) evaluation becomes increasingly complex due to novel interaction modalities, driving automation, heterogeneous data, and dynamic environmental contexts. Immersive analytics may enable efficient explorations…

Human-Computer Interaction · Computer Science 2023-02-22 Pascal Jansen , Julian Britten , Alexander Häusele , Thilo Segschneider , Mark Colley , Enrico Rukzio

Graphical User Interface (GUI) agents adopt an end-to-end paradigm that maps a screenshot to an action sequence, thereby automating repetitive tasks in virtual environments. However, existing GUI agents are evaluated almost exclusively on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Chunyi Li , Longfei Li , Zicheng Zhang , Xiaohong Liu , Min Tang , Weisi Lin , Guangtao Zhai

A current trend in industries such as semiconductors and foundry is to shift their visual inspection processes to Automatic Visual Inspection (AVI) systems, to reduce their costs, mistakes, and dependency on human experts. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Masoud Jalayer , Reza Jalayer , Amin Kaboli , Carlotta Orsenigo , Carlo Vercellis

Critical embedded systems (CES) have become ubiquitous in whether medical, automotive, or industrial. Software failures in such systems are potentially disastrous and could lead to serious consequences not only financially but also…

Software Engineering · Computer Science 2022-08-11 Hafsa Cheddadi , Saad Motahhir , Abdelaziz El Ghzizal

Context: Visual aesthetics is increasingly seen as an essential factor in perceived usability, interaction, and overall appraisal of user interfaces especially with respect to mobile applications. Yet, a question that remains is how to…

Software Engineering · Computer Science 2018-12-24 Christiane G. von Wangenheim , João V. Araujo Porto , Jean C. R. Hauck , Adriano F. Borgatto

Software visualization approaches for code reviews are often implemented as standalone applications, which use static code analysis. The goal is to visualize the structural changes introduced by a pull / merge request to facilitate the…

Software Engineering · Computer Science 2024-08-16 Alexander Krause-Glau , Lukas Damerau , Malte Hansen , Wilhelm Hasselbring

Static analysis is one of the most widely adopted techniques to find software bugs before code is put in production. Designing and implementing effective and efficient static analyses is difficult and requires high expertise, which results…

Software Engineering · Computer Science 2019-06-04 Andrew Habib , Michael Pradel

Although various visual interfaces for digital libraries have been developed in prototypical systems, very few of these visual approaches have been integrated into today's digital libraries. In this position paper we argue that this is most…

Information Retrieval · Computer Science 2014-10-02 Wilko van Hoek , Philipp Mayr

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing

Visual RAG has offered an alternative to traditional RAG. It treats documents as images and uses vision encoders to obtain vision patch tokens. However, hundreds of patch tokens per document create retrieval and storage challenges in a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ho Hung Lim , Yi Yang

Grounding natural language queries in graphical user interfaces (GUIs) poses unique challenges due to the diversity of visual elements, spatial clutter, and the ambiguity of language. In this paper, we introduce DiMo-GUI, a training-free…

Artificial Intelligence · Computer Science 2025-09-08 Hang Wu , Hongkai Chen , Yujun Cai , Chang Liu , Qingwen Ye , Ming-Hsuan Yang , Yiwei Wang

Bug reports play a critical role in software maintenance by helping users convey encountered issues to developers. Recently, GUI screen capture videos have gained popularity as a bug reporting artifact due to their ease of use and ability…

Software Engineering · Computer Science 2026-04-23 Sidong Feng , Dingbang Wang , Nikola Tomic , Tingting Yu , Aldeida Aleti , Chunyang Chen

Automotive engineering makes extensive use of numerical simulation throughout the design process. The development of numerical models, their validation against experimental tests, and their updating during vehicle and engine projects…

Computational Engineering, Finance, and Science · Computer Science 2026-03-17 Di Jiang , Sebastian Rodriguez , Herve Colin , Yves Tourbier , Francisco Chinesta

Developing intelligent agents capable of operating a wide range of Graphical User Interfaces (GUIs) with human-level proficiency is a key milestone on the path toward Artificial General Intelligence. While most existing datasets and…

Artificial Intelligence · Computer Science 2025-11-21 Sen Chen , Tong Zhao , Yi Bin , Fei Ma , Wenqi Shao , Zheng Wang

Recent advancements in multimodal large language models have driven breakthroughs in visual question answering. Yet, a critical gap persists, `conceptualization'-the ability to recognize and reason about the same concept despite variations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Zahra Babaiee , Peyman M. Kiasari , Daniela Rus , Radu Grosu

Web services are becoming business-critical components, often deployed with critical software bugs that can be maliciously explored. Web vulnerability scanners allow the detection of security vulnerabilities in web services by stressing the…

Cryptography and Security · Computer Science 2022-12-26 Osejobe Ehichoya , Chinwuba Christian Nnaemeka

Drawing principles, or aesthetics, are important in graph drawing. They are used as criteria for algorithm design and for quality evaluation. Current aesthetics are described as visual properties that a drawing is required to have to be…

Human-Computer Interaction · Computer Science 2016-09-27 Weidong Huang

Color is an important aspect of any graphical user interface (GUI). Color is used to make a GUI attractive and meaningful. But there are difficulties in using colors too. Improper use of color can result in adverse effects. Wrong colors at…

Human-Computer Interaction · Computer Science 2014-04-29 Umakant Mishra

This paper addresses the following verification task: Given a graph transformation system and a class of initial graphs, can we guarantee (non-)reachability of a given other class of graphs that characterizes bad or erroneous states? Both…

Logic in Computer Science · Computer Science 2025-04-14 Barbara König , Arend Rensink , Lara Stoltenow , Fabian Urrigshardt

Validating Advanced Driver Assistance Systems (ADAS) is a strategic issue, since such systems are becoming increasingly widespread in the automotive field. ADAS bring extra comfort to drivers, and this has become a selling point. But these…