English
Related papers

Related papers: When Refreshable Tactile Displays Meet Conversatio…

200 papers

Blind and low-vision (BLV) people use audio descriptions (ADs) to access videos. However, current ADs are unalterable by end users, thus are incapable of supporting BLV individuals' potentially diverse needs and preferences. This research…

Human-Computer Interaction · Computer Science 2024-08-22 Rosiana Natalie , Ruei-Che Chang , Smitha Sheshadri , Anhong Guo , Kotaro Hara

In a world driven by data visualization, ensuring the inclusive accessibility of charts for Blind and Visually Impaired (BVI) individuals remains a significant challenge. Charts are usually presented as raster graphics without textual and…

Human-Computer Interaction · Computer Science 2024-03-26 Omar Moured , Morris Baumgarten-Egemole , Alina Roitberg , Karin Muller , Thorsten Schwarz , Rainer Stiefelhagen

Interaction plays a vital role during visual network exploration as users need to engage with both elements in the view (e.g., nodes, links) and interface controls (e.g., sliders, dropdown menus). Particularly as the size and complexity of…

Human-Computer Interaction · Computer Science 2020-05-01 Ayshwarya Saktheeswaran , Arjun Srinivasan , John Stasko

The rapid development of generative artificial intelligence (AI) and large language models (LLMs), and the availability of services that make them accessible, have led the general public to begin incorporating them into everyday life. The…

Human-Computer Interaction · Computer Science 2025-12-18 Efe Bozkir , Enkelejda Kasneci

Individuals with Intellectual and Developmental Disabilities (IDD) have unique needs and challenges when working with data. While visualization aims to make data more accessible to a broad audience, our understanding of how to design…

Human-Computer Interaction · Computer Science 2024-08-30 Keke Wu , Ghulam Jilani Quadri , Arran Zeyu Wang , David Kwame Osei-Tutu , Emma Petersen , Varsha Koushik , Danielle Albers Szafir

Tactile graphics are often adapted from visual chart designs, yet many of these encodings do not translate effectively to non-visual exploration. Blind and low-vision (BLV) people employ a variety of physical strategies such as measuring…

Human-Computer Interaction · Computer Science 2025-10-16 Areen Khalaila , Dylan Cashman

While there is no replacement for the learned expertise, devotion, and social benefits of a guide dog, there are cases in which a robot navigation assistant could be helpful for individuals with blindness or low vision (BLV). This study…

Robotics · Computer Science 2024-06-10 Rayna Hata , Narit Trikasemsak , Andrea Giudice , Stacy A. Doore

Task-oriented dialogue (ToD) systems are designed to help users achieve specific goals through natural language interaction. While recent advances in large language models (LLMs) have significantly improved linguistic fluency and contextual…

Computation and Language · Computer Science 2025-07-03 Shutong Feng , Hsien-chin Lin , Nurul Lubis , Carel van Niekerk , Michael Heck , Benjamin Ruppik , Renato Vukovic , Milica Gašić

Multimodal large language models (MLLMs) are changing how Blind and Low Vision (BLV) people access visual information. Unlike traditional visual interpretation tools that only provide descriptions, MLLM-enabled applications offer…

Human-Computer Interaction · Computer Science 2026-02-20 Ricardo E. Gonzalez Penuela , Crescentia Jung , Sharon Y Lin , Ruiying Hu , Shiri Azenkot

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

Customization is crucial for making visualizations accessible to blind and low-vision (BLV) people with widely-varying needs. But what makes for usable or useful customization? We identify four design goals for how BLV people should be able…

Human-Computer Interaction · Computer Science 2024-03-01 Shuli Jones , Isabella Pedraza Pineros , Daniel Hajas , Jonathan Zong , Arvind Satyanarayan

Access to humanities research databases is often hindered by the limitations of traditional interaction formats, particularly in the methods of searching and response generation. This study introduces an LLM-based smart assistant designed…

Computation and Language · Computer Science 2025-06-03 Alexander Sergeev , Valeriya Goloviznina , Mikhail Melnichenko , Evgeny Kotelnikov

We present two studies exploring how blind or low-vision (BLV) family members engage with their sighted children's artwork, strategies to support understanding and interpretation, and the potential role of technology, such as AI, therein.…

Human-Computer Interaction · Computer Science 2024-10-30 Arnavi Chheda-Kothary , Jacob O. Wobbrock , Jon E. Froehlich

Online shopping has become a valuable modern convenience, but blind or low vision (BLV) users still face significant challenges using it, because of: 1) inadequate image descriptions and 2) the inability to filter large amounts of…

Human-Computer Interaction · Computer Science 2021-02-02 Ruolin Wang , Zixuan Chen , Mingrui "Ray" Zhang , Zhaoheng Li , Zhixiu Liu , Zihan Dang , Chun Yu , Xiang "Anthony" Chen

Blind and low vision (BLV) users often rely on alt text to understand what a digital image is showing. However, recent research has investigated how touch-based image exploration on touchscreens can supplement alt text. Touchscreen-based…

Human-Computer Interaction · Computer Science 2023-02-21 Vishnu Nair , Hanxiu 'Hazel' Zhu , Brian A. Smith

The rapid proliferation of data science forced different groups of individuals with different backgrounds to adapt to statistical analysis. We hypothesize that conversational agents are better suited for statistical analysis than…

Human-Computer Interaction · Computer Science 2025-02-18 Qifu Wen , Prishita Kochhar , Sherif Zeyada , Tahereh Javaheri , Reza Rawassizadeh

The ubiquity and on-the-go availability of mobile devices makes them central to many tasks such as interpersonal communication and media consumption. However, despite the potential of mobile devices for on-demand exploratory data…

Human-Computer Interaction · Computer Science 2024-04-18 Luke S. Snyder , Ryan A. Rossi , Eunyee Koh , Jeffrey Heer , Jane Hoffswell

Visualizations, such as charts, are crucial for interpreting complex data. However, they are often provided as raster images, which are not compatible with assistive technologies for people with blindness and visual impairments, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Omar Moured , Sara Alzalabny , Anas Osman , Thorsten Schwarz , Karin Muller , Rainer Stiefelhagen

Recent advances in large language models (LLMs) have propelled research in natural language interfaces to databases. However, most state-of-the-art text-to-SQL systems still depend on complex, multi-stage pipelines. This work proposes a…

Artificial Intelligence · Computer Science 2025-06-03 Fernando Granado , Roberto Lotufo , Jayr Pereira

Vision-Language-Action (VLA) models have demonstrated significant advantages in robotic manipulation. However, their reliance on vision and language often leads to suboptimal performance in tasks involving visual occlusion, fine-grained…