English
Related papers

Related papers: Nonvisual Support for Understanding and Reasoning …

200 papers

Traditional accessibility methods like alternative text and data tables typically underrepresent data visualization's full potential. Keyboard-based chart navigation has emerged as a potential solution, yet efficient data exploration…

Human-Computer Interaction · Computer Science 2024-08-20 Joshua Gorniak , Yoon Kim , Donglai Wei , Nam Wook Kim

In this paper, we propose a deep learning based assistive system to improve the environment perception experience of visually impaired (VI). The system is composed of a wearable terminal equipped with an RGBD camera and an earphone, a…

Robotics · Computer Science 2019-08-12 Yimin Lin , Kai Wang , Wanxin Yi , Shiguo Lian

Automated visualization recommendation facilitates the rapid creation of effective visualizations, which is especially beneficial for users with limited time and limited knowledge of data visualization. There is an increasing trend in…

Human-Computer Interaction · Computer Science 2023-10-19 Songheng Zhang , Haotian Li , Huamin Qu , Yong Wang

We introduce UViM, a unified approach capable of modeling a wide range of computer vision tasks. In contrast to previous models, UViM has the same functional form for all tasks; it requires no task-specific modifications which require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Alexander Kolesnikov , André Susano Pinto , Lucas Beyer , Xiaohua Zhai , Jeremiah Harmsen , Neil Houlsby

Often, the needs and visual abilities differ between the annotator group and the end user group. Generating detailed diagram descriptions for blind and low-vision (BLV) users is one such challenging domain. Sighted annotators could describe…

Artificial Intelligence · Computer Science 2025-03-18 Wan Ju Kang , Eunki Kim , Na Min An , Sangryul Kim , Haemin Choi , Ki Hoon Kwak , James Thorne

Course syllabi are often the first and sometimes only structured artifact that explains how a class will run: deadlines, grading rules, safety procedures, and how to request disability accommodations. For blind and low-vision (BLV) students…

Human-Computer Interaction · Computer Science 2025-11-12 Chadani Acharya

For over half a century, the computer mouse has been the primary tool for interacting with digital data, yet it remains a limiting factor in exploring complex, multi-scale scientific images. Traditional 2D visualization methods hinder…

STEAM education integrates Science, Technology, Engineering, Arts, and Mathematics to foster creativity and problem-solving. However, students with visual impairments (VI) encounter significant challenges in programming and robotics,…

Human-Computer Interaction · Computer Science 2025-03-24 Mahmoud Hamash , Md Raqib Khan , Peter Tiernan

We present our in-progress work on co-designing a visualization tool for presenting unstructured text. We have conducted a focus group with a variety of professionals who regularly analyze large corpora of unstructured text. Our preliminary…

Human-Computer Interaction · Computer Science 2024-07-04 Beck Langstone , Fateme Rajabiyazdi

This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizations$-$bar plots, heat maps, box plots, and scatter plots$-$leveraging multimodal data representations. In addition…

Human-Computer Interaction · Computer Science 2024-03-04 JooYoung Seo , Yilin Xia , Bongshin Lee , Sean McCurry , Yu Jun Yam

Many blind and low vision (BLV) people are excluded from professional roles that may involve visual tasks due to access barriers and persisting stigmas. Advancing generative AI systems can support BLV people through providing contextual and…

Human-Computer Interaction · Computer Science 2025-10-13 Lucy Jiang , Lotus Zhang , Leah Findlater

Immersive, stereoscopic viewing enables scientists to better analyze the spatial structures of visualized physical phenomena. However, their findings cannot be properly presented in traditional media, which lack these core attributes.…

Graphics · Computer Science 2016-11-29 Jacqueline Chu , Leonardo Ferrer , Min Shih , Kwan-Liu Ma

Effective visual accessibility in Virtual Reality (VR) is crucial for Blind and Low Vision (BLV) users. However, designing visual accessibility systems is challenging due to the complexity of 3D VR environments and the need for techniques…

Human-Computer Interaction · Computer Science 2025-02-07 Junlong Chen , Rosella P. Galindo Esparza , Vanja Garaj , Per Ola Kristensson , John Dudley

As machine learning systems increasingly inform critical decisions, the need for human-understandable explanations grows. Current evaluations of Explainable AI (XAI) often prioritize technical fidelity over cognitive accessibility which…

Human-Computer Interaction · Computer Science 2025-09-23 Tobias Labarta , Nhi Hoang , Katharina Weitz , Wojciech Samek , Sebastian Lapuschkin , Leander Weber

Despite widespread use, charts remain largely inaccessible for Low-Vision Individuals (LVI). Reading charts requires viewing data points within a global context, which is difficult for LVI who may rely on magnification or experience a…

Human-Computer Interaction · Computer Science 2026-03-04 Yotam Sechayk , Hennes Rave , Max Rädler , Mark Colley , Zhongyi Zhou , Ariel Shamir , Takeo Igarashi

Current resources for data literacy education, such as visualization galleries and datasets, provide useful examples but lack mechanisms for learners to query, compare, and navigate the visualization design space efficiently. This position…

Human-Computer Interaction · Computer Science 2026-04-16 Huyen N. Nguyen , Nils Gehlenborg

The increasing integration of Artificial Intelligence (AI) into everyday life makes it essential to explain AI-based decision-making in a way that is understandable to all users, including those with disabilities. Accessible explanations…

Human-Computer Interaction · Computer Science 2025-12-18 Chukwunonso Henry Nwokoye , Maria J. P. Peixoto , Akriti Pandey , Lauren Pardy , Mahadeo Sukhai , Peter R. Lewis

In visual question answering (VQA), a machine must answer a question given an associated image. Recently, accessibility researchers have explored whether VQA can be deployed in a real-world setting where users with visual impairments learn…

Computation and Language · Computer Science 2022-10-28 Yang Trista Cao , Kyle Seelman , Kyungjun Lee , Hal Daumé

Access to textual and visual information for visually impaired persons becomes very difficult with screen readers which are not adapted to different websites.This paper analyses the use of different technologies for access digital content…

Human-Computer Interaction · Computer Science 2019-11-18 Katerine Romeo , Edwige Pissaloux , Frédéric Serin

State-of-the-art vision-language models (VLMs) still have limited performance in structural knowledge extraction, such as relations between objects. In this work, we present ViStruct, a training framework to learn VLMs for effective visual…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yangyi Chen , Xingyao Wang , Manling Li , Derek Hoiem , Heng Ji