English
Related papers

Related papers: Object Localization Assistive System Based on CV a…

200 papers

Haptic technology enhances interactive experiences by providing force and tactile feedback, improving user performance and immersion. However, despite advancements, creating tactile experiences still remains challenging due to device…

Human-Computer Interaction · Computer Science 2025-08-28 Tom Roy , Yann Glemarec , Gurvan Lecuyer , Quentin Galvane , Philippe Guillotel , Ferran Argelaguet

Object locating in virtual reality (VR) has been widely used in many VR applications, such as virtual assembly, virtual repair, virtual remote coaching. However, when there are a large number of objects in the virtual environment(VE), the…

Human-Computer Interaction · Computer Science 2022-12-08 Xiaoheng Wei , Xuehuai Shi , Lili Wang

Robotic guidance systems have shown promise in supporting blind and visually impaired (BVI) individuals with wayfinding and obstacle avoidance. However, most existing systems assume a clear path and do not support a critical aspect of…

Robotics · Computer Science 2026-03-17 Shaojun Cai , Nuwan Janaka , Ashwin Ram , Janidu Shehan , Yingjia Wan , Kotaro Hara , David Hsu

Deformable objects often appear in unstructured configurations. Tracing deformable objects helps bringing them into extended states and facilitating the downstream manipulation tasks. Due to the requirements for object-specific modeling or…

People who are blind or have low vision (BLV) encounter numerous challenges in their daily lives and work. To support them, various haptic assistive tools have been developed. Despite these advancements, the effective utilization of these…

Human-Computer Interaction · Computer Science 2024-12-30 Chutian Jiang , Emily Kuang , Mingming Fan

GPS and smartphones enable users to place location-based annotations, capturing rich environmental context. Previous research demonstrates that blind and low vision (BLV) people can use annotations to explore unfamiliar areas. However,…

Navigating unfamiliar environments remains one of the most persistent and critical challenges for people who are blind or have limited vision (BLV). Existing assistive tools often rely on online services or APIs, making them costly,…

Human-Computer Interaction · Computer Science 2025-10-28 Dabbrata Das , Argho Deb Das , Farhan Sadaf , Azhar Uddin , Tirtho Mondal

Early visual to auditory substitution devices encode 2D monocular images into sounds while more recent devices use distance information from 3D sensors. This study assesses whether the addition of sound-encoded distance in recent systems…

Human-Computer Interaction · Computer Science 2022-04-14 Louis Commère , Jean Rouat

Finding obstacle-free paths in unknown environments is a big navigation issue for visually impaired people and autonomous robots. Previous works focus on obstacle avoidance, however they do not have a general view of the environment they…

Rich contact perception is crucial for robotic manipulation, yet traditional tactile skins remain expensive and complex to integrate. This paper presents a scalable alternative: high-accuracy whole-body touch localization via vibro-acoustic…

Robotics · Computer Science 2026-01-29 Wadhah Zai El Amri , Nicolás Navarro-Guerrero

Visually impaired individuals face significant challenges navigating and interacting with unknown situations, particularly in tasks requiring spatial awareness and semantic scene understanding. To accelerate the development and evaluate the…

According to the World Health Organization, visual impairment is estimated to affect approximately 2.2 billion people worldwide. The visually impaired must currently rely on navigational aids to replace their sense of sight, like a white…

Human-Computer Interaction · Computer Science 2022-06-23 Stanley Shen

We implemented a system able to locate people indoor, with the purpose of providing assistive services. Such approach is particularly important for the Art, for providing information on exhibitions, art galleries and museums, and to allow…

Human-Computer Interaction · Computer Science 2022-12-14 Osvaldo Gervasi , Martina Fortunelli , Riccardo Magni , Damiano Perri , Marco Simonetti

The aim of this work is to contribute to the development of a tactile device for visually impaired and blind persons in order to let them to understand actions of the surrounding people and to interact with them. First, based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Leyla Benhamida , Slimane Larabi

Several animal species (e.g., bats, dolphins, and whales) and even visually impaired humans have the remarkable ability to perform echolocation: a biological sonar used to perceive spatial layout and locate objects in the world. We explore…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Ruohan Gao , Changan Chen , Ziad Al-Halah , Carl Schissler , Kristen Grauman

In today's society, where independent living is becoming increasingly important, it can be extremely constricting for those who are blind. Blind and visually impaired (BVI) people face challenges because they need manual support to prompt…

Human-Computer Interaction · Computer Science 2023-03-15 Malay Joshi , Aditi Shukla , Jayesh Srivastava , Manya Rastogi

Retrieving an object from cluttered spaces suchas cupboards, refrigerators, or bins requires tracking objects with limited or no visual sensing. In these scenarios, contact feedback is necessary to estimate the pose of the objects, yet the…

Robotics · Computer Science 2022-01-26 Sheng Zhong , Nima Fazeli , Dmitry Berenson

LLM-Glasses is a wearable navigation system which assists visually impaired people by utilizing YOLO-World object detection, GPT-4o-based reasoning, and haptic feedback for real-time guidance. The device translates visual scene…

Human-Computer Interaction · Computer Science 2026-01-21 Issatay Tokmurziyev , Miguel Altamirano Cabrera , Muhammad Haris Khan , Yara Mahmoud , Dzmitry Tsetserukou

Object recognition technologies hold the potential to support blind and low-vision people in navigating the world around them. However, the gap between benchmark performances and practical usability remains a significant challenge. This…

Human-Computer Interaction · Computer Science 2024-08-07 Jonggi Hong , Hernisa Kacorri

Tactile sensing is one of the modalities humans rely on heavily to perceive the world. Working with vision, this modality refines local geometry structure, measures deformation at the contact area, and indicates the hand-object contact…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wenqiang Xu , Zhenjun Yu , Han Xue , Ruolin Ye , Siqiong Yao , Cewu Lu