English
Related papers

Related papers: Vibration-based communication for deafblind people

200 papers

Knowing who is in one's vicinity is key to managing privacy in everyday environments, but is challenging for people with visual impairments. Wearable cameras and other sensors may be able to detect such information, but how should this…

Human-Computer Interaction · Computer Science 2019-04-15 Tousif Ahmed , Rakibul Hasan , Kay Connelly , David Crandall , Apu Kapadia

With the ever-growing expansion of mobile technology worldwide, there is an increasing need for accommodation for those who are disabled. This project explores how machine learning and computer vision could be utilized to improve…

Human-Computer Interaction · Computer Science 2024-04-02 Jasur Shukurov

Perceiving spatial information of a virtual object (e.g, direction, distance) is critical yet challenging for blind users seeking an immersive virtual reality (VR) experience. To facilitate VR accessibility for blind users, in this paper,…

Human-Computer Interaction · Computer Science 2025-02-19 Jiasheng Li , Zining Zhang , Zeyu Yan , Yuhang Zhao , Huaishu Peng

This study aimed to develop a system that provides vibrotactile feedback corresponding to the emotional content of text when a communication robot speaks. We used OpenAI's "GPT-4o Mini" for emotion estimation, extracting valence and arousal…

Human-Computer Interaction · Computer Science 2024-11-11 Yuki Konishi , Yoshihiro Tanaka

Text input on mobile devices without physical keys can be challenging for people who are blind or low-vision. We interview 12 blind adults about their experiences with current mobile text input to provide insights into what sorts of…

Human-Computer Interaction · Computer Science 2025-10-03 Dylan Gaines , Keith Vertanen

Visual-inertial odometry (VIO) has demonstrated remarkable success due to its low-cost and complementary sensors. However, existing VIO methods lack the generalization ability to adjust to different environments and sensor attributes. In…

Robotics · Computer Science 2024-05-28 Youqi Pan , Wugen Zhou , Yingdian Cao , Hongbin Zha

Mobile systems are equipped with a diverse collection of I/O devices, including cameras, microphones, sensors, and modems. There exist many novel use cases for allowing an application on one mobile system to utilize I/O devices from…

Operating Systems · Computer Science 2013-12-18 Ardalan Amiri Sani , Kevin Boos , Min Hong Yun , Lin Zhong

Block-based programming environments like Scratch have become widely adopted in Computer Science Education, but the mouse-based drag-and-drop interface can challenge users with disabilities. While prior work has provided solutions…

Software Engineering · Computer Science 2026-03-31 Elias Goller , Gordon Fraser , Isabella Graßl

At present many blind assistive systems have been implemented but there is no such kind of good system to navigate a blind person and also to track the movement of a blind person and rescue him/her if he/she is lost. In this paper, we have…

Human-Computer Interaction · Computer Science 2016-12-04 Md. Siddiqur Rahman Tanveer , M. M. A. Hashem , Md. Kowsar Hossain

Blind people face a lot of problems in their daily routines. They have to struggle a lot just to do their day-to-day chores. In this paper, we have proposed a system with the objective to help the visually impaired by providing audio aid…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Nikhil Thakurdesai , Anupam Tripathi , Dheeraj Butani , Smita Sankhe

The aim of this study is to introduce an application that enables information sharing and communication between visually-impaired individuals and able-bodied. For the purposes of the study, web-based audio library automation was designed…

Computers and Society · Computer Science 2017-04-18 Aslihan Tufekci , Yahya Balaman , Utku Kose

This study proposes a real-time system that translates voluntary eye blinks into Morse code, enabling communication for individuals with severe motor impairments. Using a standard webcam and computer vision, the system detects and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Anushka Bhatt

Traditionally, clinicians use tuning forks as a binary measure to assess vibrotactile sensory perception. This approach has low measurement resolution, and the vibrations are highly variable. Therefore, we propose using vibrations from a…

Human-Computer Interaction · Computer Science 2022-06-22 Rachel A. G. Adenekan , Alexis J. Lowber , Bryce N. Huerta , Allison M. Okamura , Kyle T. Yoshida , Cara M. Nunez

Grasping constitutes a critical challenge for visually impaired people. To address this problem, we developed a tactile bracelet that assists in grasping by guiding the user's hand to a target object using vibration commands. Here we…

Human-Computer Interaction · Computer Science 2025-04-24 Marcin Furtak , Florian Pätzold , Tim Kietzmann , Silke M. Kärcher , Peter König

Recognizing surfaces based on their vibration signatures is useful as it can enable tagging of different locations without requiring any additional hardware such as Near Field Communication (NFC) tags. However, previous vibration based…

Signal Processing · Electrical Eng. & Systems 2020-08-31 Kamran Ali , Alex X. Liu

Spatialized vibrotactile feedback systems deliver tactile information by placing multiple vibrotactile actuators on the body. As increasing numbers of actuators are required to adequately convey information in complicated applications,…

Human-Computer Interaction · Computer Science 2025-02-14 Bingjian Huang , Siyi Ren , Yuewen Luo , Qilong Cheng , Hanfeng Cai , Yeqi Sang , Mauricio Sousa , Paul H. Dietz , Daniel Wigdor

Vibrations emitted by smartphones have become a part of our daily lives. The vibrations can add various meanings to the information people obtain from the screen. Hence, it is worth understanding the perceptual transformation of vibration…

Human-Computer Interaction · Computer Science 2023-03-03 Keiko Yamaguchi , Satoshi Takahashi

This research paper addresses the limitations of current mobile accessibility services like TalkBack, which provide manual gesture-based sequential feedback to BVI users. Motivated by the promise of large language models (LLMs), this paper…

Human-Computer Interaction · Computer Science 2026-05-12 Joshua Owusu Ansah , Anuj Kapoor , Ayush Khanna , Manvika Vinod , Precious Njeck , Shuai Gao

Voice User Interfaces (VUIs) owing to recent developments in Artificial Intelligence (AI) and Natural Language Processing (NLP), are becoming increasingly intuitive and functional. They are especially promising for older adults, also with…

Human-Computer Interaction · Computer Science 2021-01-01 Anna Jaskulska , Kinga Skorupska , Barbara Karpowicz , Cezary Biele , Jarosław Kowalski , Wiesław Kopeć

Dexterous prosthetic hands have better grasp performance than traditional ones. However, patients still find it difficult to use these hands without a suitable control system. A new hybrid myoelectric control system, termed i-MYO, is…

Robotics · Computer Science 2022-05-19 Chunyuan Shi , Dapeng Yang , Jingdong Zhao , Li Jiang