English
Related papers

Related papers: Advanced Audio Aid for Blind People

200 papers

People with blindness and low vision (pBLV) experience significant challenges when locating final destinations or targeting specific objects in unfamiliar environments. Furthermore, besides initially locating and orienting oneself to a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Yu Hao , Junchi Feng , John-Ross Rizzo , Yao Wang , Yi Fang

In this study we describe a methodology to realize visual images cognition in the broader sense, by a cross-modal stimulation through the auditory channel. An original algorithm of conversion from bi-dimensional images to sounds has been…

Neurons and Cognition · Quantitative Biology 2017-05-16 Takahisa Kishino , Sun Zhe , Roberto Marchisio , Ruggero Micheletto

We aim to help users estimate the state of the world in tasks like robotic teleoperation and navigation with visual impairments, where users may have systematic biases that lead to suboptimal behavior: they might struggle to process…

Machine Learning · Computer Science 2020-08-10 Siddharth Reddy , Sergey Levine , Anca D. Dragan

In the last years several solutions were proposed to support people with visual impairments or blindness during road crossing. These solutions focus on computer vision techniques for recognizing pedestrian crosswalks and computing their…

Human-Computer Interaction · Computer Science 2015-06-25 Sergio Mascetti , Lorenzo Picinali , Andrea Gerino , Dragan Ahmetovic , Cristian Bernareggi

Accessibility of websites for visually impaired persons is mishandled by screen readers which are not always adapted to interactivity needed by actual web/multimedia technologies. This paper analyses the difficulties to access to…

Human-Computer Interaction · Computer Science 2019-12-09 Katerine Romeo , Edwige Pissaloux , Frédéric Serin

The paper presents the design of an assistive reading tool that integrates read-aloud technology with eye-tracking to regulate the speed of reading and support struggling readers in following the text while listening to it. The paper…

Human-Computer Interaction · Computer Science 2021-03-10 Gianluca Schiavo , Nadia Mana , Ornella Mich , Massimo Zancanaro , Remo Job

Audio description, a form of trans-modal media translation, allows people who are blind or visually impaired access to visually-oriented, socio-cultural, or historical public discourse alike. Although audio description has gained more…

Human-Computer Interaction · Computer Science 2018-09-18 Philipp Jordan , Brett Oppegaard

Voice recognition technology enables the execution of real-world operations through a single voice command. This paper introduces a voice recognition system that involves converting input voice signals into corresponding text using an…

Robotics · Computer Science 2023-12-08 Lochan Basyal

Accessibility assessments typically focus on determining a binary measurement of task performance success/failure; and often neglect to acknowledge the nuances of those interactions. Although a large population of blind people find…

Human-Computer Interaction · Computer Science 2021-04-14 André Rodrigues , André Santos , Kyle Montague , Tiago Guerreiro

Object recognition technologies hold the potential to support blind and low-vision people in navigating the world around them. However, the gap between benchmark performances and practical usability remains a significant challenge. This…

Human-Computer Interaction · Computer Science 2024-08-07 Jonggi Hong , Hernisa Kacorri

Neural networks in assistive technology for visually impaired leverage artificial intelligence's capacity to recognize patterns in complex data. They are used for converting visual data into auditory or tactile representations, helping the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Sochukwuma Nwokoye , Desmond Moru

Shopping is a routine activity for sighted individuals, yet for people who are blind or have low vision (pBLV), locating and retrieving products in physical environments remains a challenge. This paper presents a multimodal wearable…

Human-Computer Interaction · Computer Science 2026-01-21 Ligao Ruan , Giles Hamilton-Fletcher , Mahya Beheshti , Todd E Hudson , Maurizio Porfiri , John-Ross Rizzo

It is estimated that around 70 million people worldwide are affected by a speech disorder called stuttering. With recent advances in Automatic Speech Recognition (ASR), voice assistants are increasingly useful in our everyday lives. Many…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-14 Olabanji Shonibare , Xiaosu Tong , Venkatesh Ravichandran

We introduce the active audio-visual source separation problem, where an agent must move intelligently in order to better isolate the sounds coming from an object of interest in its environment. The agent hears multiple audio sources…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Sagnik Majumder , Ziad Al-Halah , Kristen Grauman

The prevalence of mobile technology offers unique opportunities for addressing healthcare challenges, especially for individuals with visual impairments. This paper explores the development and implementation of a deep learning-based mobile…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Bo Dang , Wenchao Zhao , Yufeng Li , Danqing Ma , Qixuan Yu , Elly Yijun Zhu

Communication is essential feature in human communities. For some reasons, deaf-mute disabled people lose their ability to hear, speak, or both which makes them suffer to communicate and convey their ideas, especially with normal people.…

Signal Processing · Electrical Eng. & Systems 2025-03-20 Hussein Naeem Hasan

People who are blind employ unique strategies when performing instrumental activities of daily living (iADLs), often relying on multiple sensory modalities and assistive technologies. While prior research has extensively explored adaptive…

Human-Computer Interaction · Computer Science 2025-02-25 Lily M. Turkstra , Tanya Bhatia , Alexa Van Os , Michael Beyeler

The rapid growth of virtual reality (VR) has led to increased use of social VR platforms for interaction. However, these platforms lack adequate features to support blind and low vision (BLV) users, posing significant challenges in…

Human-Computer Interaction · Computer Science 2026-03-31 Jazmin Collins , Kaylah Myranda Nicholson , Yusuf Khadir , Andrea Stevenson Won , Shiri Azenkot

Visually impaired people face significant challenges when attempting to interact with and understand complex environments, and traditional assistive technologies often struggle to quickly provide necessary contextual understanding and…

Human-Computer Interaction · Computer Science 2025-05-02 Bhanuja Ainary

To help the blind people walk to the destination efficiently and safely in indoor environment, a novel wearable navigation device is presented in this paper. The locating, way-finding, route following and obstacle avoiding modules are the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Jinqiang Bai , Shiguo Lian , Zhaoxiang Liu , Kai Wang , Dijun Liu