English
Related papers

Related papers: VisBuddy -- A Smart Wearable Assistant for the Vis…

200 papers

This paper explores the principles for transforming a quadrupedal robot into a guide robot for individuals with visual impairments. A guide robot has great potential to resolve the limited availability of guide animals that are accessible…

Robotics · Computer Science 2024-04-08 J. Taery Kim , Wenhao Yu , Yash Kothari , Jie Tan , Greg Turk , Sehoon Ha

Learning disorders are neurological conditions that affect the brain's ability to interconnect communication areas. Dyslexic students experience problems with reading, memorizing, and exposing concepts; however the magnitude of these can be…

Visually impaired (VI) people often face challenges when performing everyday tasks and identify shopping for clothes as one of the most challenging. Many engage in online shopping, which eliminates some challenges of physical shopping.…

Human-Computer Interaction · Computer Science 2023-05-22 Amnah Alluqmani , Morgan Harvey , Ziqi Zhang

Spatial perception, particularly at small and medium scales, is an essential human sense but poses a significant challenge for the blind and visually impaired (BVI). Traditional learning methods for BVI individuals are often constrained by…

Human-Computer Interaction · Computer Science 2024-08-27 Xiaoqing Jing , Chun Yu , Kun Yue , Liangyou Lu , Nan Gao , Weinan Shi , Mingshan Zhang , Ruolin Wang , Yuanchun Shi

Context awareness is an essential part of mobile and ubiquitous computing. Its goal is to unveil situational information about mobile users like locations and activities. The sensed context can enable many services like navigation, AR, and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Xiaochen Liu

Assistive technologies for people with visual impairments (PVI) have made significant advancements, particularly with the integration of artificial intelligence (AI) and real-time sensor technologies. However, current solutions often…

Human-Computer Interaction · Computer Science 2024-10-08 He Zhang , Nicholas J. Falletta , Jingyi Xie , Rui Yu , Sooyeon Lee , Syed Masum Billah , John M. Carroll

Multimodal large language models (MLLMs) are changing how Blind and Low Vision (BLV) people access visual information. Unlike traditional visual interpretation tools that only provide descriptions, MLLM-enabled applications offer…

Human-Computer Interaction · Computer Science 2026-02-20 Ricardo E. Gonzalez Penuela , Crescentia Jung , Sharon Y Lin , Ruiying Hu , Shiri Azenkot

Social VR has increased in popularity due to its affordances for rich, embodied, and nonverbal communication. However, nonverbal communication remains inaccessible for blind and low vision people in social VR. We designed accessible cues…

Human-Computer Interaction · Computer Science 2024-10-30 Crescentia Jung , Jazmin Collins , Ricardo E. Gonzalez Penuela , Jonathan Isaac Segal , Andrea Stevenson Won , Shiri Azenkot

Bionic vision uses neuroprostheses to restore useful vision to people living with incurable blindness. However, a major outstanding challenge is predicting what people 'see' when they use their devices. The limited field of view of current…

Human-Computer Interaction · Computer Science 2022-03-14 Justin Kasowski , Michael Beyeler

This study explores the use of virtual reality (VR) as an innovative tool to enhance awareness, acceptance, and understanding of accessibility for persons with vision loss (VL). Through a VR-based workshop developed in collaboration with…

Human-Computer Interaction · Computer Science 2024-11-27 F. S. Ricci , C. K. Ukegbu , A. Krassner , S. Hazarika , J. White , M. Porfiri , J. R. Rizzo

Remote sighted assistance (RSA) has emerged as a conversational assistive technology, where remote sighted workers, i.e., agents, provide real-time assistance to users with vision impairments via video-chat-like communication. Researchers…

Human-Computer Interaction · Computer Science 2022-02-04 Jingyi Xie , Rui Yu , Sooyeon Lee , Yao Lyu , Syed Masum Billah , John M. Carroll

Approximately 200 million individuals around the world suffer from varying degrees of visual impairment, making it crucial to leverage AI technology to offer walking assistance for these people. With the recent progress of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhiqiang Yuan , Ting Zhang , Ying Deng , Jiapei Zhang , Yeshuang Zhu , Zexi Jia , Jie Zhou , Jinchao Zhang

The spatial behavior of passersby can be critical to blind individuals to initiate interactions, preserve personal space, or practice social distancing during a pandemic. Among other use cases, wearable cameras employing computer vision can…

Human-Computer Interaction · Computer Science 2021-09-14 Kyungjun Lee , Daisuke Sato , Saki Asakawa , Chieko Asakawa , Hernisa Kacorri

Exploring an unfamiliar indoor environment and avoiding obstacles is challenging for visually impaired people. Currently, several approaches achieve the avoidance of static obstacles based on the mapping of indoor scenes. To solve the issue…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Wenyan Ou , Jiaming Zhang , Kunyu Peng , Kailun Yang , Gerhard Jaworek , Karin Müller , Rainer Stiefelhagen

Effective visual accessibility in Virtual Reality (VR) is crucial for Blind and Low Vision (BLV) users. However, designing visual accessibility systems is challenging due to the complexity of 3D VR environments and the need for techniques…

Human-Computer Interaction · Computer Science 2025-02-07 Junlong Chen , Rosella P. Galindo Esparza , Vanja Garaj , Per Ola Kristensson , John Dudley

Millions of visually impaired people depend on relatives and friends to perform their everyday tasks. One relevant step towards self-sufficiency is to provide them with means to verify the value and operation presented in payment machines.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Guilherme Folego , Filipe Costa , Bruno Costa , Alan Godoy , Luiz Pita

Indoor navigation is challenging due to the absence of satellite positioning. This challenge is manifold greater for Visually Impaired People (VIPs) who lack the ability to get information from wayfinding signage. Other sensor signals…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Jun Yu , Yifan Zhang , Badrinadh Aila , Vinod Namboodiri

The purpose of this paper is to enhance the performance of the virtual assistant. So, what exactly is a virtual assistant. Application software, often called virtual assistants, also known as AI assistants or digital assistants, is software…

Human-Computer Interaction · Computer Science 2023-03-14 Jagbeer Singh , Yash Goel , Shubhi Jain , Shiva Yadav

Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene…

Sound · Computer Science 2022-03-01 Dengxin Dai , Arun Balajee Vasudevan , Jiri Matas , Luc Van Gool

By the year 2023, the global population of individuals with impaired vision has surpassed 220 million. People with impaired vision will find it difficult while finding path or avoiding obstacles, and must ask for auxiliary tools for help.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Feifan Yan , Tianle Zeng , Meixi He