English
Related papers

Related papers: Don't Confuse! Redrawing GUI Navigation Flow in Mo…

200 papers

Object-goal navigation is a challenging task that requires guiding an agent to specific objects based on first-person visual observations. The ability of agent to comprehend its surroundings plays a crucial role in achieving successful…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Nuo Xu , Wen Wang , Rong Yang , Mengjie Qin , Zheyuan Lin , Wei Song , Chunlong Zhang , Jason Gu , Chao Li

Current visual navigation strategies mainly follow an exploration-first and then goal-directed navigation paradigm. This exploratory phase inevitably compromises the overall efficiency of navigation. Recent studies propose leveraging floor…

Robotics · Computer Science 2026-01-21 Weiqi Huang , Jiaxin Li , Zan Wang , Huijun Di , Wei Liang , Zhu Yang

This research aims to find where visually impaired users find appliances hard to use and suggest guideline to solve this issue. 181 visually impaired users have been surveyed, and 12 visually impaired users have been selected based on…

Human-Computer Interaction · Computer Science 2024-07-10 Hyunjin An , Hyundoug Kim , Seungwoo Hong , Youngsun Shin

Recommendation Systems are effective in managing the ever-increasing amount of multimodal data available today and help users discover interesting new items. These systems can handle various media types such as images, text, audio, and…

Machine Learning · Computer Science 2026-03-03 Haimonti Dutta , Pruthvi Moluguri , Jin Dai , Saurabh Amarnath Mahindre

Guided image restoration (GIR), such as guided depth map super-resolution and pan-sharpening, aims to enhance a target image using guidance information from another image of the same scene. Currently, joint image filtering-inspired deep…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xinyi Liu , Qian Zhao , Jie Liang , Hui Zeng , Deyu Meng , Lei Zhang

New tactile interfaces such as swell form printing or refreshable tactile displays promise to allow visually impaired people to analyze data. However, it is possible that design guidelines and familiar encodings derived from experiments on…

Human-Computer Interaction · Computer Science 2024-10-14 Areen Khalaila , Lane Harrison , Nam Wook Kim , Dylan Cashman

Graphical User Interface (GUI) Agents, benefiting from recent advances in multimodal large language models (MLLM), have achieved significant development. However, due to the frequent updates of GUI applications, adapting to new tasks…

Machine Learning · Computer Science 2026-03-10 Zhenquan Yao , Zitong Huang , Yihan Zeng , Jianhua Han , Hang Xu , Chun-Mei Feng , Jianwei Ma , Wangmeng Zuo

Graphical User Interface (GUI) agents extend large language models from text generation to action execution in real-world digital environments. Unlike conversational systems, GUI agents perform irreversible operations such as submitting…

Machine Learning · Computer Science 2026-02-25 Yucheng Shi , Wenhao Yu , Jingyuan Huang , Wenlin Yao , Wenhu Chen , Ninghao Liu

We introduce ChartA11y, an app developed to enable accessible 2-D visualizations on smartphones for blind users through a participatory and iterative design process involving 13 sessions with two blind partners. We also present a design…

Human-Computer Interaction · Computer Science 2024-10-29 Zhuohao Jerry Zhang , John R. Thompson , Aditi Shah , Manish Agrawal , Alper Sarikaya , Jacob O. Wobbrock , Edward Cutrell , Bongshin Lee

Blind navigation is an accessibility application that enables blind to use an android Smartphone in an easy way for indoor navigation with instructions in audio form. We have proposed a prototype which is an indoor navigation application…

Human-Computer Interaction · Computer Science 2025-09-29 Affan Idrees , Zahid Iqbal , Maria Ishfaq

In this paper, we propose to identify compromised mobile devices from a network administrator's point of view. Intuitively, inadvertent users (and thus their devices) who download apps through untrustworthy markets are often allured to…

Cryptography and Security · Computer Science 2019-11-28 Euijin Choo , Mohamed Nabeel , Mashael Alsabah , Issa Khalil , Ting Yu , Wei Wang

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel GNN models…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-20 Rishov Sarkar , Stefan Abi-Karam , Yuqi He , Lakshmi Sathidevi , Cong Hao

Web content should be accessible to normal and disabled communities on electronic devices. The Web Accessibility Initiative (WAI) has created standard guidelines called Web Content Accessibility Guidelines (WCAG). Mobile Web Best Practice…

Computers and Society · Computer Science 2023-06-21 Muhammad Ishaq

Most software applications contain graphics such as charts, diagrams and maps. Currently, these graphics are designed with a ``one size fits all" approach and do not cater to the needs of people with disabilities. Therefore, when using…

Human-Computer Interaction · Computer Science 2024-01-12 Anuradha Madugalla , Yutan Huang , John Grundy , Min Hee Cho , Lasith Koswatta Gamage , Tristan Leao , Sam Thiele

Graph Neural Networks (GNNs) have achieved significant success across various applications. However, their complex structures and inner workings can be challenging for non-AI experts to understand. To address this issue, this study presents…

Human-Computer Interaction · Computer Science 2025-12-18 Yilin Lu , Chongwei Chen , Yuxin Chen , Kexin Huang , Marinka Zitnik , Qianwen Wang

Navigating unfamiliar environments remains one of the most persistent and critical challenges for people who are blind or have limited vision (BLV). Existing assistive tools often rely on online services or APIs, making them costly,…

Human-Computer Interaction · Computer Science 2025-10-28 Dabbrata Das , Argho Deb Das , Farhan Sadaf , Azhar Uddin , Tirtho Mondal

Individual fairness (IF) in graph neural networks (GNNs), which emphasizes the need for similar individuals should receive similar outcomes from GNNs, has been a critical issue. Despite its importance, research in this area has been largely…

Machine Learning · Computer Science 2025-06-24 Yuchang Zhu , Jintang Li , Huizhe Zhang , Liang Chen , Zibin Zheng

Android OS is severely fragmented by API updates and device vendors' OS customization, creating a market condition where vastly different OS versions coexist. This gives rise to compatibility crash problems where Android apps crash on…

Human-Computer Interaction · Computer Science 2024-06-04 Donghwi Kim , Hyungjun Yoon , Chang Min Park , Sujin Han , Youngjin Kwon , Steven Y. Ko , Sung-Ju Lee

The demand for quality in mobile applications has increased greatly given users' high reliance on them for daily tasks. Developers work tirelessly to ensure that their applications are both functional and user-friendly. In pursuit of this,…

Software Engineering · Computer Science 2025-05-16 Safwat Ali Khan

While commendable progress has been made in user-centric research on mobile assistive systems for blind and low-vision (BLV) individuals, references that directly inform robot navigation design remain rare. To bridge this gap, we conducted…