English
Related papers

Related papers: An AI-Based Shopping Assistant System to Support t…

200 papers

Indoor built environments like homes and offices often present complex and cluttered layouts that pose significant challenges for individuals who are blind or visually impaired, especially when performing tasks that involve locating and…

Robotics · Computer Science 2025-09-03 Yifan Xu , Qianwei Wang , Vineet Kamat , Carol Menassa

Consider an assistive system that guides visually impaired users through speech and haptic feedback to their destination. Existing robotic and ubiquitous navigation technologies (e.g., portable, ground, or wearable systems) often operate in…

Machine Learning · Computer Science 2018-10-09 Eshed Ohn-Bar , Kris Kitani , Chieko Asakawa

Robot-assisted dressing has the potential to significantly improve the lives of individuals with mobility impairments. To ensure an effective and comfortable dressing experience, the robot must be able to handle challenging deformable…

Robotics · Computer Science 2025-09-17 Alexis Yihong Hao , Yufei Wang , Navin Sriram Ravie , Bharath Hegde , David Held , Zackory Erickson

Augmented Reality (AR) technology creates new immersive experiences in entertainment, games, education, retail, and social media. AR content is often primarily visual and it is challenging to enable access to it non-visually due to the mix…

Human-Computer Interaction · Computer Science 2020-10-14 Jaylin Herskovitz , Jason Wu , Samuel White , Amy Pavel , Gabriel Reyes , Anhong Guo , Jeffrey P. Bigham

AI assistants are increasingly integrated into older adults' daily lives, offering new opportunities for social support and accessibility while raising important questions about privacy, autonomy, and trust. As these systems become embedded…

Computers and Society · Computer Science 2025-05-07 Karina LaRubbio , Malcolm Grba , Diana Freed

Interactive streetscape mapping tools such as Google Street View (GSV) and Meta Mapillary enable users to virtually navigate and experience real-world environments via immersive 360{\deg} imagery but remain fundamentally inaccessible to…

Human-Computer Interaction · Computer Science 2025-09-29 Jon E. Froehlich , Alexander Fiannaca , Nimer Jaber , Victor Tsaran , Shaun Kane

Blind people use artificial intelligence-enabled visual assistance technologies (AI VAT) to gain visual access in their everyday lives, but these technologies are embedded with errors that may be difficult to verify non-visually. Previous…

Human-Computer Interaction · Computer Science 2024-08-14 Rahaf Alharbi , Pa Lor , Jaylin Herskovitz , Sarita Schoenebeck , Robin Brewer

People with special needs like blind and visually impaired (BVI) people can particularly benefit from using voice assistants providing spoken information input and output in everyday life. However, it is crucial to understand their needs…

Human-Computer Interaction · Computer Science 2022-03-14 Christina Oumard , Julian Kreimeier , Timo Götzelmann

Assistive technologies and in particular assistive robotic arms have the potential to enable people with motor impairments to live a self-determined life. More and more of these systems have become available for end users in recent years,…

Human-Computer Interaction · Computer Science 2024-07-19 Max Pascher , Kirill Kronhardt , Jan Freienstein , Jens Gerken

The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system,…

Information Retrieval · Computer Science 2024-04-01 Yue Zheng , Lei Yu , Junmian Chen , Tianyu Xia , Yuanyuan Yin , Shan Wang , Haiming Liu

This paper proposes an interactive system for mobile devices controlled by hand gestures aimed at helping people with visual impairments. This system allows the user to interact with the device by making simple static and dynamic hand…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Samer Alashhab , Antonio Javier Gallego , Miguel Ángel Lozano

Psychological counseling is a highly personalized and dynamic process that requires therapists to continuously monitor emotional changes, document session insights, and maintain therapeutic continuity. In this paper, we introduce…

Human-Computer Interaction · Computer Science 2025-04-24 Xianghe Liu , Jiaqi Xu , Tao Sun

Existing assistive technologies (AT) often adopt a one-size-fits-all approach, overlooking the diverse needs of people with visual impairments (PVI). Do-it-yourself AT (DIY-AT) toolkits offer one path toward customization, but most remain…

Human-Computer Interaction · Computer Science 2026-02-17 Ben Kosa , Hsuanling Lee , Jasmine Li , Sanbrita Mondal , Yuhang Zhao , Liang He

Unlike the free exploration of childhood, the demands of daily life reduce our motivation to explore our surroundings, leading to missed opportunities for informal learning. Traditional tools for knowledge acquisition are reactive, relying…

Human-Computer Interaction · Computer Science 2025-02-25 Runze Cai , Nuwan Janaka , Hyeongcheol Kim , Yang Chen , Shengdong Zhao , Yun Huang , David Hsu

In an era where AI is evolving from a passive tool into an active and adaptive companion, we introduce AI for Service (AI4Service), a new paradigm that enables proactive and real-time assistance in daily life. Existing AI services remain…

Artificial Intelligence · Computer Science 2025-10-17 Zichen Wen , Yiyu Wang , Chenfei Liao , Boxue Yang , Junxian Li , Weifeng Liu , Haocong He , Bolong Feng , Xuyang Liu , Yuanhuiyi Lyu , Xu Zheng , Xuming Hu , Linfeng Zhang

In a so-called overpopulated world, sustainable consumption is of existential importance.However, the expanding spectrum of product choices and their production complexity challenge consumers to make informed and value-sensitive decisions.…

Computers and Society · Computer Science 2020-12-07 Thomas Asikis , Johannes Klinglmayr , Dirk Helbing , Evangelos Pournaras

Robotic guidance systems have shown promise in supporting blind and visually impaired (BVI) individuals with wayfinding and obstacle avoidance. However, most existing systems assume a clear path and do not support a critical aspect of…

Robotics · Computer Science 2026-03-17 Shaojun Cai , Nuwan Janaka , Ashwin Ram , Janidu Shehan , Yingjia Wan , Kotaro Hara , David Hsu

AI tools like ChatGPT and Be-My-AI are increasingly being used by blind individuals. Although prior work has explored their use in some Do-It-Yourself (DIY) tasks by blind individuals, little is known about how they use these tools and the…

Human-Computer Interaction · Computer Science 2026-02-24 Monalika Padma Reddy , Aruna Balasubramanian , Jiawei Zhou , Xiaojun Bi , IV Ramakrishnan , Vikas Ashok

The proposed system aims to be a techno-friend of visually impaired people to assist them in orientation and mobility both indoor and outdoor. Moving through an unknown environment becomes a real challenge for most of them, although they…

Human-Computer Interaction · Computer Science 2021-12-03 Shyama Kumari Arunachalam , Roopa V , Meena H B , Vijayalakshmi , T Malavika

This paper explores the effectiveness of Multimodal Large Language models (MLLMs) as assistive technologies for visually impaired individuals. We conduct a user survey to identify adoption patterns and key challenges users face with such…