English
Related papers

Related papers: Identifying Crucial Objects in Blind and Low-Visio…

200 papers

Knowing who is in one's vicinity is key to managing privacy in everyday environments, but is challenging for people with visual impairments. Wearable cameras and other sensors may be able to detect such information, but how should this…

Human-Computer Interaction · Computer Science 2019-04-15 Tousif Ahmed , Rakibul Hasan , Kay Connelly , David Crandall , Apu Kapadia

GPS and smartphones enable users to place location-based annotations, capturing rich environmental context. Previous research demonstrates that blind and low vision (BLV) people can use annotations to explore unfamiliar areas. However,…

Accurate identification of important objects in the scene is a prerequisite for safe and high-quality decision making and motion planning of intelligent agents (e.g., autonomous vehicles) that navigate in complex and dynamic environments.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Jiachen Li , Haiming Gang , Hengbo Ma , Masayoshi Tomizuka , Chiho Choi

We investigate whether tactile charts support comprehension and learning of complex visualizations for blind and low-vision (BLV) individuals and contribute four tactile chart designs and an interview study. Visualizations are powerful…

Human-Computer Interaction · Computer Science 2025-08-11 Tingying He , Maggie McCracken , Daniel Hajas , Sarah Creem-Regehr , Alexander Lex

Over 43 million people worldwide live with severe visual impairment, facing significant challenges in navigating unfamiliar environments. We present MR.NAVI, a mixed reality system that enhances spatial awareness for visually impaired users…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Nicolas Pfitzer , Yifan Zhou , Marco Poggensee , Defne Kurtulus , Bessie Dominguez-Dager , Mihai Dusmanu , Marc Pollefeys , Zuria Bauer

Navigational challenges significantly impact the independence and mobility of Individuals with Visual Impairment (IVI). While numerous assistive technologies exist, their adoption remains limited due to usability challenges, financial…

Human-Computer Interaction · Computer Science 2025-04-10 Iman Soltani , Johnaton Schofield , Mehran Madani , Daniel Kish , Parisa Emami-Naeini

Video games are increasingly accessible to blind and low vision (BLV) players, yet many aspects remain inaccessible. One aspect is the joy players feel when they explore environments and make new discoveries, which is integral to many…

Human-Computer Interaction · Computer Science 2024-03-18 Vishnu Nair , Hanxiu 'Hazel' Zhu , Peize Song , Jizhong Wang , Brian A. Smith

We introduce the Lecture Video Visual Objects (LVVO) dataset, a new benchmark for visual object detection in educational video content. The dataset consists of 4,000 frames extracted from 245 lecture videos spanning biology, computer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Dipayan Biswas , Shishir Shah , Jaspal Subhlok

Visual impairment affects hundreds of millions of people worldwide, severely limiting their ability to navigate urban environments safely and independently. While wearable assistive devices offer a promising platform for real-time hazard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Antoni Valls , Jordi Sanchez-Riera

Intelligent assistive systems can navigate blind people, but most of them could only give non-intuitive cues or inefficient guidance. Based on computer vision and vibrotactile encoding, this paper presents an interactive system that…

Robotics · Computer Science 2022-06-22 Zhikai Wei , Xuhui Hu

Visually impaired people encounter many challenges in their everyday life, especially when it comes to navigating and representing space. The issue of shopping is addressed mostly on the level of navigation and product detection, but…

Human-Computer Interaction · Computer Science 2020-10-12 Lancelot Dupont , Christophe Jouffrais , Simon T. Perrault

Robotic guide dogs hold significant potential to enhance the autonomy and mobility of blind or visually impaired (BVI) individuals by offering universal assistance over unstructured terrains at affordable costs. However, the design of…

Robotics · Computer Science 2025-01-09 J. Taery Kim , Morgan Byrd , Jack L. Crandell , Bruce N. Walker , Greg Turk , Sehoon Ha

The utilization of deep learning-based object detection is an effective approach to assist visually impaired individuals in avoiding obstacles. In this paper, we implemented seven different YOLO object detection models \textit{viz}.,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Chenhao He , Pramit Saha

Blind and low vision (BLV) users often rely on alt text to understand what a digital image is showing. However, recent research has investigated how touch-based image exploration on touchscreens can supplement alt text. Touchscreen-based…

Human-Computer Interaction · Computer Science 2023-02-21 Vishnu Nair , Hanxiu 'Hazel' Zhu , Brian A. Smith

Object recognition technologies hold the potential to support blind and low-vision people in navigating the world around them. However, the gap between benchmark performances and practical usability remains a significant challenge. This…

Human-Computer Interaction · Computer Science 2024-08-07 Jonggi Hong , Hernisa Kacorri

Our work aims to develop new assistive technologies that enable blind or low vision (BLV) people to explore and analyze data readily. At present, barriers exist for BLV people to explore and analyze data, restricting access to government,…

Human-Computer Interaction · Computer Science 2025-07-01 Samuel Reinders , Munazza Zaib , Matthew Butler , Bongshin Lee , Ingrid Zukerman , Lizhen Qu , Kim Marriott

As able-bodied people, we often take our vision for granted. For people who are visually impaired, however, their disability can have a significant impact on their daily lives. We are developing proprietary headgear that will help visually…

Human-Computer Interaction · Computer Science 2023-11-08 Kumar Srinivas Bobba , Kartheeban K , Vamsi Krishna Sai Boddu , Vijaya Mani Surendra Bolla , Dinesh Bugga

We present a semi-supervised approach that localizes multiple unknown object instances in long videos. We start with a handful of labeled boxes and iteratively learn and label hundreds of thousands of object instances. We propose criteria…

Computer Vision and Pattern Recognition · Computer Science 2015-05-22 Ishan Misra , Abhinav Shrivastava , Martial Hebert

Wearable technologies are enabling plenty of new applications of computer vision, from life logging to health assistance. Many of them are required to recognize the elements of interest in the scene captured by the camera. This work studies…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Alberto Sabater , Luis Montesano , Ana C. Murillo

Blind people have limited opportunities to explore an environment based on their interests. While existing navigation systems could provide them with surrounding information while navigating, they have limited scalability as they require…

Human-Computer Interaction · Computer Science 2025-02-14 Masaki Kuribayashi , Kohei Uehara , Allan Wang , Shigeo Morishima , Chieko Asakawa