English
Related papers

Related papers: StreetReaderAI: Making Street View Accessible Usin…

200 papers

As social VR applications grow in popularity, blind and low vision users encounter continued accessibility barriers. Yet social VR, which enables multiple people to engage in the same virtual space, presents a unique opportunity to allow…

Human-Computer Interaction · Computer Science 2024-10-30 Jazmin Collins , Crescentia Jung , Yeonju Jang , Danielle Montour , Andrea Stevenson Won , Shiri Azenkot

The increasing integration of Artificial Intelligence (AI) into everyday life makes it essential to explain AI-based decision-making in a way that is understandable to all users, including those with disabilities. Accessible explanations…

Human-Computer Interaction · Computer Science 2025-12-18 Chukwunonso Henry Nwokoye , Maria J. P. Peixoto , Akriti Pandey , Lauren Pardy , Mahadeo Sukhai , Peter R. Lewis

This paper presents a wearable assistive device with the shape of a pair of eyeglasses that allows visually impaired people to navigate safely and quickly in unfamiliar environment, as well as perceive the complicated environment to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Jinqiang Bai , Zhaoxiang Liu , Yimin Lin , Ye Li , Shiguo Lian , Dijun Liu

Effective visual accessibility in Virtual Reality (VR) is crucial for Blind and Low Vision (BLV) users. However, designing visual accessibility systems is challenging due to the complexity of 3D VR environments and the need for techniques…

Human-Computer Interaction · Computer Science 2025-02-07 Junlong Chen , Rosella P. Galindo Esparza , Vanja Garaj , Per Ola Kristensson , John Dudley

With the ever-growing expansion of mobile technology worldwide, there is an increasing need for accommodation for those who are disabled. This project explores how machine learning and computer vision could be utilized to improve…

Human-Computer Interaction · Computer Science 2024-04-02 Jasur Shukurov

Street-level visual appearances play an important role in studying social systems, such as understanding the built environment, driving routes, and associated social and economic factors. It has not been integrated into a typical…

Human-Computer Interaction · Computer Science 2024-04-02 Tsung Heng Wu , Md Amiruzzaman , Ye Zhao , Deepshikha Bhati , Jing Yang

Lacking the ability to sense ambient environments effectively, blind and visually impaired people (BVIP) face difficulty in walking outdoors, especially in urban areas. Therefore, tools for assisting BVIP are of great importance. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Haobin Tan , Chang Chen , Xinyu Luo , Jiaming Zhang , Constantin Seibold , Kailun Yang , Rainer Stiefelhagen

To help the blind people walk to the destination efficiently and safely in indoor environment, a novel wearable navigation device is presented in this paper. The locating, way-finding, route following and obstacle avoiding modules are the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Jinqiang Bai , Shiguo Lian , Zhaoxiang Liu , Kai Wang , Dijun Liu

"Scene description" applications that describe visual content in a photo are useful daily tools for blind and low vision (BLV) people. Researchers have studied their use, but they have only explored those that leverage remote sighted…

Human-Computer Interaction · Computer Science 2025-03-13 Ricardo Gonzalez , Jazmin Collins , Shiri Azenkot , Cynthia Bennett

Blind people have limited opportunities to explore an environment based on their interests. While existing navigation systems could provide them with surrounding information while navigating, they have limited scalability as they require…

Human-Computer Interaction · Computer Science 2025-02-14 Masaki Kuribayashi , Kohei Uehara , Allan Wang , Shigeo Morishima , Chieko Asakawa

Artificial intelligence systems are widely used by people with sensory disabilities, like loss of vision or hearing, to help perceive or navigate the world around them. This includes tasks like describing an image or object they cannot…

Human-Computer Interaction · Computer Science 2026-03-04 Shadab H. Choudhury

People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI…

Human-Computer Interaction · Computer Science 2024-07-15 Jingyi Xie , Rui Yu , He Zhang , Sooyeon Lee , Syed Masum Billah , John M. Carroll

Assistive technologies for the visually impaired have evolved to facilitate interaction with a complex and dynamic world. In this paper, we introduce AIris, an AI-powered wearable device that provides environmental awareness and interaction…

Human-Computer Interaction · Computer Science 2024-08-13 Dionysia Danai Brilli , Evangelos Georgaras , Stefania Tsilivaki , Nikos Melanitis , Konstantina Nikita

Individuals with ambulatory disabilities often encounter significant barriers when navigating urban environments due to the lack of accessible information and tools. This paper presents OmniAcc, an AI-powered interactive navigation system…

Artificial Intelligence · Computer Science 2025-09-10 Siddhant Karki , Ethan Han , Nadim Mahmud , Suman Bhunia , John Femiani , Vaskar Raychoudhury

For people affected by blindness and low vision (BLV), safe and independent navigation remains a major challenge, impacting over 2.2 billion individuals worldwide. Although multimodal large language models (MLLMs) offer new opportunities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Junhyeok Kim , Jaewoo Park , Junhee Park , Sangeyl Lee , Jiwan Chung , Jisung Kim , Ji Hoon Joung , Youngjae Yu

Finding obstacle-free paths in unknown environments is a big navigation issue for visually impaired people and autonomous robots. Previous works focus on obstacle avoidance, however they do not have a general view of the environment they…

This paper explores the effectiveness of Multimodal Large Language models (MLLMs) as assistive technologies for visually impaired individuals. We conduct a user survey to identify adoption patterns and key challenges users face with such…

Safely navigating street intersections is a complex challenge for blind and low-vision individuals, as it requires a nuanced understanding of the surrounding context - a task heavily reliant on visual cues. Traditional methods for assisting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Hochul Hwang , Sunjae Kwon , Yekyung Kim , Donghyun Kim

Robotic guide dogs hold significant potential to enhance the autonomy and mobility of blind or visually impaired (BVI) individuals by offering universal assistance over unstructured terrains at affordable costs. However, the design of…

Robotics · Computer Science 2025-01-09 J. Taery Kim , Morgan Byrd , Jack L. Crandell , Bruce N. Walker , Greg Turk , Sehoon Ha

Combining conversational AI with refreshable tactile displays (RTDs) offers significant potential for creating accessible data visualization for people who are blind or have low vision (BLV). To support researchers and developers building…

Human-Computer Interaction · Computer Science 2026-02-18 Samuel Reinders , Munazza Zaib , Matthew Butler , Bongshin Lee , Ingrid Zukerman , Lizhen Qu , Kim Marriott