English
Related papers

Related papers: A Heuristic Process for GUI Widget Matching Across…

200 papers

Usability evaluations are essential for ensuring that modern interfaces meet user needs, yet traditional heuristic evaluations by human experts can be time-consuming and subjective, especially early in development. This paper investigates…

Software Engineering · Computer Science 2025-12-05 Nolan Platt , Ethan Luchs , Sehrish Nizamani

This article proposes a universal simulation platform for simulating systems undergoing duress. In other words, this paper introduces a total simulation package which includes a number of methods of simulating the flexibility of a given…

Optimization and Control · Mathematics 2017-10-20 Vu Hoang Minh , Tajwar Abrar Aleef , Usama Pervaiz , Yeman Brhane Hagos , Saed Khawaldeh

Normally, program execution spends most of the time on loops. Automated test data generation devotes special attention to loops for better coverage. Automated test data generation for programs having loops with variable number of iteration…

Software Engineering · Computer Science 2010-11-03 Hitesh Tahbildar , Bichitra Kalita

The current trend in next-generation exascale systems goes towards integrating a wide range of specialized (co-)processors into traditional supercomputers. However, the integration of different specialized devices increases the degree of…

Programming Languages · Computer Science 2016-03-11 Guillermo Vigueras , Manuel Carro , Salvador Tamarit , Julio Mariño

Sketching out Graphical User Interface (GUI) layout is part of the pipeline of designing a GUI and a crucial task for the success of a software application. Arranging all components inside a GUI layout manually is a time-consuming task. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Andrey Sobolevsky , Guillaume-Alexandre Bilodeau , Jinghui Cheng , Jin L. C. Guo

Structural parameters are normally extracted from observed galaxies by fitting analytic light profiles to the observations. Obtaining accurate fits to high-resolution images is a computationally expensive task, requiring many model…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 Benjamin R. Barsdell , David G. Barnes , Christopher J. Fluke

Graphical User Interface (GUI) Agents, powered by large language and vision-language models, hold promise for enabling end-to-end automation in digital environments. However, their progress is fundamentally constrained by the scarcity of…

Machine Learning · Computer Science 2025-09-22 Musen Lin , Minghao Liu , Taoran Lu , Lichen Yuan , Yiwei Liu , Haonan Xu , Yu Miao , Yuhao Chao , Zhaojian Li

Interactive applications incorporating high-data rate sensing and computer vision are becoming possible due to novel runtime systems and the use of parallel computation resources. To allow interactive use, such applications require careful…

Machine Learning · Computer Science 2012-03-19 Qian Zhu , Branislav Kveton , Lily Mummert , Padmanabhan Pillai

Artificial Intelligence algorithms have now become pervasive in multiple high-stakes domains. However, their internal logic can be obscure to humans. Explainable Artificial Intelligence aims to design tools and techniques to illustrate the…

Human-Computer Interaction · Computer Science 2024-04-29 Eleonora Cappuccio , Daniele Fadda , Rosa Lanzilotti , Salvatore Rinzivillo

Users often rely on GUIs to edit and interact with visualizations - a daunting task due to the large space of editing options. As a result, users are either overwhelmed by a complex UI or constrained by a custom UI with a tailored, fixed…

Human-Computer Interaction · Computer Science 2024-01-22 Priyan Vaithilingam , Elena L. Glassman , Jeevana Priya Inala , Chenglong Wang

Graphical User Interface (GUI) automation holds significant promise for assisting users with complex tasks, thereby boosting human productivity. Existing works leveraging Large Language Model (LLM) or LLM-based AI agents have shown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Difei Gao , Lei Ji , Zechen Bai , Mingyu Ouyang , Peiran Li , Dongxing Mao , Qinchen Wu , Weichen Zhang , Peiyi Wang , Xiangwu Guo , Hengxu Wang , Luowei Zhou , Mike Zheng Shou

Graphical user interfaces (GUI) automation agents are emerging as powerful tools, enabling humans to accomplish increasingly complex tasks on smart devices. However, users often inadvertently omit key information when conveying tasks, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ziming Cheng , Zhiyuan Huang , Junting Pan , Zhaohui Hou , Mingjie Zhan

In recent years, mobile accessibility has become an important trend with the goal of allowing all users the possibility of using any app without many limitations. User reviews include insights that are useful for app evolution. However,…

Software Engineering · Computer Science 2022-10-19 Eman Abdullah AlOmar , Wajdi Aljedaani , Murtaza Tamjeed , Mohamed Wiem Mkaouer , Yasmine N. Elglaly

We present the first nontrivial procedure for configuring heuristic algorithms to maximize the utility provided to their end users while also offering theoretical guarantees about performance. Existing procedures seek configurations that…

Artificial Intelligence · Computer Science 2023-11-01 Devon R. Graham , Kevin Leyton-Brown , Tim Roughgarden

Pluralistic image completion focuses on generating both visually realistic and diverse results for image completion. Prior methods enjoy the empirical successes of this task. However, their used constraints for pluralistic image completion…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Xiaobo Xia , Wenhao Yang , Jie Ren , Yewen Li , Yibing Zhan , Bo Han , Tongliang Liu

With the rapid development of web technology, more and more software applications have become web-based in the past decades. To ensure software quality and user experience, various techniques have been proposed to automatically test web…

Software Engineering · Computer Science 2024-10-17 Siyi Wang , Sinan Wang , Yujia Fan , Xiaolei Li , Yepang Liu

Many of the artificial intelligence techniques developed to date rely on heuristic search through large spaces. Unfortunately, the size of these spaces and the corresponding computational effort reduce the applicability of otherwise novel…

Artificial Intelligence · Computer Science 2011-05-30 D. J. Cook , R. C. Varnell

GUI task automation streamlines repetitive tasks, but existing LLM or VLM-based planner-executor agents suffer from brittle generalization, high latency, and limited long-horizon coherence. Their reliance on single-shot reasoning or static…

Artificial Intelligence · Computer Science 2025-09-29 Seoyoung Lee , Seonbin Yoon , Seongbeen Lee , Hyesoo Kim , Joo Yong Sim

Graphical User Interface (GUI) agents extend large language models from text generation to action execution in real-world digital environments. Unlike conversational systems, GUI agents perform irreversible operations such as submitting…

Machine Learning · Computer Science 2026-02-25 Yucheng Shi , Wenhao Yu , Jingyuan Huang , Wenlin Yao , Wenhu Chen , Ninghao Liu

Gaussian process (GP) models are commonly used statistical metamodels for emulating expensive computer simulators. Fitting a GP model can be numerically unstable if any pair of design points in the input space are close together. Ranjan,…

Computation · Statistics 2015-11-20 Blake MacDonald , Pritam Ranjan , Hugh Chipman