English
Related papers

Related papers: Don't Confuse! Redrawing GUI Navigation Flow in Mo…

200 papers

The Graphical User Interface (GUI) plays a central role in mobile applications, directly affecting usability and user satisfaction. Poor GUI performance, such as lag or unresponsiveness, can lead to negative user experience and decreased…

Software Engineering · Computer Science 2025-02-07 Wei Liu , Feng Lin , Linqiang Guo , Tse-Hsun Chen , Ahmed E. Hassan

Humans can flexibly switch between different modes of thinking based on task complexity: from rapid intuitive judgments to in-depth analytical understanding. However, current Graphical User Interface (GUI) grounding systems which locate…

Artificial Intelligence · Computer Science 2025-03-11 Fei Tang , Yongliang Shen , Hang Zhang , Siqi Chen , Guiyang Hou , Wenqi Zhang , Wenqiao Zhang , Kaitao Song , Weiming Lu , Yueting Zhuang

Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomously interact with digital systems or software applications…

Graph Neural Networks (GNNs) have shown great power in various domains. However, their predictions may inherit societal biases on sensitive attributes, limiting their adoption in real-world applications. Although many efforts have been…

Machine Learning · Computer Science 2023-06-21 Huaisheng Zhu , Guoji Fu , Zhimeng Guo , Zhiwei Zhang , Teng Xiao , Suhang Wang

In this paper, we address an issue that the visually impaired commonly face while crossing intersections and propose a solution that takes form as a mobile application. The application utilizes a deep learning convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Samuel Yu , Heon Lee , Jung Hoon Kim

Financial management has been revolutionized by mobile banking, but increasing usefulness and satisfaction requires a better user experience. This study aims to provide an improved customer experience by offering user-friendly interfaces,…

Human-Computer Interaction · Computer Science 2026-04-09 Luniva Chitrakar , Ishan Panta , Biplov Paneru , Sangharsh Poudel , Lahana Kansakar

The graph-based model can help to detect suspicious fraud online. Owing to the development of Graph Neural Networks~(GNNs), prior research work has proposed many GNN-based fraud detection frameworks based on either homogeneous graphs or…

Social and Information Networks · Computer Science 2020-07-03 Zhiwei Liu , Yingtong Dou , Philip S. Yu , Yutong Deng , Hao Peng

While users could embody virtual avatars that mirror their physical movements in Virtual Reality, these avatars' motions can be redirected to enable novel interactions. Excessive redirection, however, could break the user's sense of…

Human-Computer Interaction · Computer Science 2025-02-17 Zhipeng Li , Yishu Ji , Ruijia Chen , Tianqi Liu , Yuntao Wang , Yuanchun Shi , Yukang Yan

Navigation instruction generation for visually impaired (VI) individuals (NIG-VI) is critical yet relatively underexplored. This study focuses on generating precise, in-situ, step-by-step navigation instructions that are practically usable…

Computation and Language · Computer Science 2025-12-19 Yi Zhao , Siqi Wang , Jing Li

Though visual and repeat navigation is a convenient solution for mobile robot self-navigation, achieving balance between efficiency and robustness in task environment still remains challenges. In this paper, we propose a novel visual and…

Robotics · Computer Science 2025-07-18 Jikai Wang , Yunqi Cheng , Zonghai Chen

Graph Neural Networks (GNNs) are popular deep learning models designed to process graph-structured data through recursive neighborhood aggregations in the message passing process. When applied to semi-supervised node classification, the…

Machine Learning · Computer Science 2025-01-13 Kevin Mancini , Islem Rekik

As an attempt towards assessing the robustness of embodied navigation agents, we propose RobustNav, a framework to quantify the performance of embodied navigation agents when exposed to a wide variety of visual - affecting RGB inputs - and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Prithvijit Chattopadhyay , Judy Hoffman , Roozbeh Mottaghi , Aniruddha Kembhavi

In image restoration, single-step discriminative mappings often lack fine details via expectation learning, whereas generative paradigms suffer from inefficient multi-step sampling and noise-residual coupling. To address this dilemma, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zihao Fan , Xin Lu , Jie Xiao , Dong Li , Jie Huang , Xueyang Fu

With the widespread use of Graph Neural Networks (GNNs) for representation learning from network data, the fairness of GNN models has raised great attention lately. Fair GNNs aim to ensure that node representations can be accurately…

Social and Information Networks · Computer Science 2024-10-23 Guixian Zhang , Guan Yuan , Debo Cheng , Lin Liu , Jiuyong Li , Shichao Zhang

Control flow graphs (CFGs) are essential tools for understanding program behavior, yet the size of real-world CFGs makes them difficult to interpret. With thousands of nodes and edges, sophisticated graph drawing algorithms are required to…

Human-Computer Interaction · Computer Science 2025-11-10 Philipp Schaad , Tal Ben-Nun , Torsten Hoefler

Fairness-aware Graph Neural Networks (GNNs) often face a challenging trade-off, where prioritizing fairness may require compromising utility. In this work, we re-examine fairness through the lens of spectral graph theory, aiming to…

Machine Learning · Computer Science 2024-08-14 Renqiang Luo , Huafei Huang , Shuo Yu , Zhuoyang Han , Estrid He , Xiuzhen Zhang , Feng Xia

Reconfigurable intelligent surface (RIS) is emerging as a promising technology for next-generation wireless communication networks, offering a variety of merits such as the ability to tailor the communication environment. Moreover,…

Signal Processing · Electrical Eng. & Systems 2025-04-22 Mengbing Liu , Chongwen Huang , Ahmed Alhammadi , Marco Di Renzo , Merouane Debbah , Chau Yuen

Recent advancements in Graphical User Interface (GUI) agents have predominantly focused on training paradigms like supervised fine-tuning (SFT) and reinforcement learning (RL). However, the challenge of high-dynamic GUI environments remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Enqi Liu , Liyuan Pan , Zhi Gao , Yan Yang , Chenrui Shi , Yang Liu , Jingrong Wu , Qing Li

Accurate and efficient power flow (PF) analysis is crucial in modern electrical networks' operation and planning. Therefore, there is a need for scalable algorithms that can provide accurate and fast solutions for both small and large scale…

Machine Learning · Computer Science 2024-02-14 Nan Lin , Stavros Orfanoudakis , Nathan Ordonez Cardenas , Juan S. Giraldo , Pedro P. Vergara

Knowledge graph construction (KGC) from (semi-)structured data is challenging, and facilitating user involvement is an issue frequently brought up within this community. We cannot deny the progress we have made with respect to (declarative)…

Human-Computer Interaction · Computer Science 2025-05-14 Ademar Crotti Junior , Christophe Debruyne