English
Related papers

Related papers: Conversational User Interfaces for Blind Knowledge…

200 papers

Large Language Models have become widely adopted tools due to their versatile capabilities, yet their user interfaces remain limited, often following rigid, linear interaction paradigms. In this paper, we present insights from a design…

Human-Computer Interaction · Computer Science 2025-08-27 Maximilian Frank , Simon Lund

Conversational User Interfaces such as Voice Assistants are hugely popular. Yet they are designed to be monolingual by default, lacking support for, or sensitivity to, the bilingual dialogue experience. In this provocation paper, we…

Human-Computer Interaction · Computer Science 2022-06-22 Helin Cihan , Yunhan Wu , Paola Peña , Justin Edwards , Benjamin Cowan

The difficulty and consequent fear of travel is one of the most disabling consequences of blindness and severe vision impairment, affecting confidence and quality of life. Traditional tactile graphics are vital in the Orientation and…

Human-Computer Interaction · Computer Science 2025-01-17 Leona Holloway , Kim Marriott , Matthew Butler , Samuel Reinders

The rapid adoption of generative AI in software development has impacted the industry, yet its effects on developers with visual impairments remain largely unexplored. To address this gap, we used an Activity Theory framework to examine how…

Human-Computer Interaction · Computer Science 2025-03-24 Claudia Flores-Saviaga , Benjamin V. Hanrahan , Kashif Imteyaz , Steven Clarke , Saiph Savage

Highly Automated Vehicles (HAVs) can improve mobility for blind and visually impaired people (BVIPs). However, designing non-visual interfaces that enable them to maintain situation awareness inside the vehicle is a challenge. This paper…

Human-Computer Interaction · Computer Science 2025-07-28 Luca-Maxim Meinhardt , Enrico Rukzio

The role of conversational assistants has become more prevalent in helping people increase their productivity. Document-centered assistance, for example to help an individual quickly review a document, has seen less significant progress,…

Computation and Language · Computer Science 2020-02-04 Maartje ter Hoeve , Robert Sim , Elnaz Nouri , Adam Fourney , Maarten de Rijke , Ryen W. White

Humans sense of distance depends on the integration of multi sensory cues. The incoming visual luminance, auditory pitch and tactile vibration could all contribute to the ability of distance judgement. This ability can be enhanced if the…

Human-Computer Interaction · Computer Science 2020-02-18 Feng Feng , Tony Stockman

Visually impaired people face numerous challenges when it comes to transportation. Not only must they circumvent obstacles while navigating, but they also need access to essential information related to available public transport,…

Human-Computer Interaction · Computer Science 2017-03-08 Gourav G. Shenoy , Mangirish A. Wagle , Kay Connelly

The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system,…

Information Retrieval · Computer Science 2024-04-01 Yue Zheng , Lei Yu , Junmian Chen , Tianyu Xia , Yuanyuan Yin , Shan Wang , Haiming Liu

Large multimodal models (LMMs) have enabled new AI-powered applications that help people with visual impairments (PVI) receive natural language descriptions of their surroundings through audible text. We investigated how this emerging…

Human-Computer Interaction · Computer Science 2025-02-25 Jingyi Xie , Rui Yu , He Zhang , Syed Masum Billah , Sooyeon Lee , John M. Carroll

As machine learning systems increasingly inform critical decisions, the need for human-understandable explanations grows. Current evaluations of Explainable AI (XAI) often prioritize technical fidelity over cognitive accessibility which…

Human-Computer Interaction · Computer Science 2025-09-23 Tobias Labarta , Nhi Hoang , Katharina Weitz , Wojciech Samek , Sebastian Lapuschkin , Leander Weber

Teleoperation emerged as a promising fallback for situations beyond the capabilities of automated vehicles. Nevertheless, teleoperation still faces challenges, such as reduced situational awareness. Since situational awareness is primarily…

Human-Computer Interaction · Computer Science 2025-05-01 Maria-Magdalena Wolf , Henrik Schmidt , Michael Christl , Jana Fank , Frank Diermeyer

In the past decades, integrated development environments (IDEs) have been largely advanced to facilitate common software engineering tasks. Yet, with growing information needs driven by increasing complexity in developing modern…

Software Engineering · Computer Science 2021-11-02 Haipeng Cai

Searching for objects in unfamiliar scenarios is a challenging task for blind people. It involves specifying the target object, detecting it, and then gathering detailed information according to the user's intent. However, existing…

Human-Computer Interaction · Computer Science 2025-05-01 Ruiping Liu , Jiaming Zhang , Angela Schön , Karin Müller , Junwei Zheng , Kailun Yang , Anhong Guo , Kathrin Gerling , Rainer Stiefelhagen

Computer-based tests (CBTs) play an important role in the professional career of any person. Universities use CBTs for admissions. Further, many large courses use CBTs for evaluation and grading. Almost all software companies use CBTs to…

Human-Computer Interaction · Computer Science 2019-05-07 Pawan Kr Patel , Amey Karkare

Unpleasant social interactions on the road can negatively affect driving safety. At the same time, researchers have attempted to address social discomfort by exploring Conversational User Interfaces (CUIs) as social mediators. Before…

Human-Computer Interaction · Computer Science 2024-05-28 Alexandra Bremers , Natalie Friedman , Sam Lee , Tong Wu , Eric Laurier , Malte Jung , Jorge Ortiz , Wendy Ju

Low-income individuals can face multiple challenges in their ability to seek employment. Barriers to employment often include limited access to digital literacy resources, training, interview preparation and resume feedback. Prior work has…

The integration of brain-computer interfaces (BCIs) into the realm of smart wheelchair (SW) technology signifies a notable leap forward in enhancing the mobility and autonomy of individuals with physical disabilities. BCIs are a technology…

Human-Computer Interaction · Computer Science 2024-04-30 Shiva Ghasemi , Denis Gracanin , Mohammad Azab

The paper describes the interaction design of a hand-held interface supporting the self-management of Type 1 diabetes. It addresses well-established clinical and human-computer interaction requirements. The design exploits three…

Computers and Society · Computer Science 2020-08-11 Robert Spence , Chukwuma Uduku , Kezhi Li , Nick Oliver , Pantelis Georgiou

Since the launch of Google Glass in 2014, smart glasses have mainly been designed to support micro-interactions. The ultimate goal for them to become an augmented reality interface has not yet been attained due to an encumbrance of…

Human-Computer Interaction · Computer Science 2017-08-01 Lik-Hang Lee , Pan Hui