English
Related papers

Related papers: Tactile Vega-Lite: Rapidly Prototyping Tactile Cha…

200 papers

Vision-Language-Action (VLA) models have recently emerged as powerful generalists for robotic manipulation. However, due to their predominant reliance on visual modalities, they fundamentally lack the physical intuition required for…

Robotics · Computer Science 2026-02-02 Yuzhe Huang , Pei Lin , Wanlin Li , Daohan Li , Jiajun Li , Jiaming Jiang , Chenxi Xiao , Ziyuan Jiao

Domain-specific languages (DSLs) for visualization aim to facilitate visualization creation by providing abstractions that offload implementation and execution details from users to the system layer. Therefore, DSLs often execute…

Human-Computer Interaction · Computer Science 2023-09-20 Junran Yang , Alex Bäuerle , Dominik Moritz , Çağatay Demiralp

Visualisations are commonly used to understand social, biological and other kinds of networks. Currently, we do not know how to effectively present network data to people who are blind or have low-vision (BLV). We ran a controlled study…

Human-Computer Interaction · Computer Science 2020-04-01 Yalong Yang , Kim Marriott , Matthew Butler , Cagatay Goncu , Leona Holloway

Screen readers are audio-based software that Blind and Low Vision (BLV) people use to interact with computing devices, such as tablets and smartphones. Although this technology has significantly improved the accessibility of touchscreen…

Human-Computer Interaction · Computer Science 2025-10-20 Ricardo Gonzalez , Fannie Liu , Blair MacIntyre , David Saffo

Blind and low vision (BLV) developers create websites to share knowledge and showcase their work. A well-designed website can engage audiences and deliver information effectively, yet it remains challenging for BLV developers to review…

Human-Computer Interaction · Computer Science 2024-07-26 Mina Huh , Amy Pavel

Natural-language-to-visualization (NL2VIS) systems based on large language models (LLMs) have substantially improved the accessibility of data visualization. However, their further adoption is hindered by two coupled challenges: (i) the…

Human-Computer Interaction · Computer Science 2026-01-23 Marko Hostnik , Rauf Kurbanov , Yaroslav Sokolov , Artem Trofimov

For people with visual impairments, tactile graphics are an important means to learn and explore information. However, raised line tactile graphics created with traditional materials such as embossing are static. While available refreshable…

Human-Computer Interaction · Computer Science 2017-08-15 Ryo Suzuki , Abigale Stangl , Mark D. Gross , Tom Yeh

Touch is an important sensing modality for humans, but it has not yet been incorporated into a multimodal generative language model. This is partially due to the difficulty of obtaining natural language labels for tactile data and the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Letian Fu , Gaurav Datta , Huang Huang , William Chung-Ho Panitch , Jaimyn Drake , Joseph Ortiz , Mustafa Mukadam , Mike Lambeta , Roberto Calandra , Ken Goldberg

For individuals with blindness or low vision (BLV), navigating complex environments can pose serious risks. Large Vision-Language Models (LVLMs) show promise for generating scene descriptions, but their effectiveness for BLV users remains…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Na Min An , Eunki Kim , Wan Ju Kang , Sangryul Kim , James Thorne , Hyunjung Shim

Interfaces for creating visualizations typically embrace one of several common forms. Textual specification enables fine-grained control, shelf building facilitates rapid exploration, while chart choosing promotes immediacy and simplicity.…

Human-Computer Interaction · Computer Science 2021-01-27 Andrew McNutt , Ravi Chugh

Tactile sensing offers rich and complementary information to vision and language, enabling robots to perceive fine-grained object properties. However, existing tactile sensors lack standardization, leading to redundant features that hinder…

Robotics · Computer Science 2026-02-03 Yiyun Zhou , Mingjing Xu , Jingwei Shi , Quanjiang Li , Jingyuan Chen

Natural language interfaces (NLIs) have shown great promise for visual data analysis, allowing people to flexibly specify and interact with visualizations. However, developing visualization NLIs remains a challenging task, requiring…

Human-Computer Interaction · Computer Science 2020-11-25 Arpit Narechania , Arjun Srinivasan , John Stasko

Data visualizations are typically not accessible to blind and low-vision (BLV) users. Automatically generating text descriptions offers an enticing mechanism for democratizing access to the information held in complex scientific charts, yet…

Human-Computer Interaction · Computer Science 2025-03-25 Andrew McNutt , Maggie K McCracken , Ishrat Jahan Eliza , Daniel Hajas , Jake Wagoner , Nate Lanza , Jack Wilburn , Sarah Creem-Regehr , Alexander Lex

We present Animated Vega-Lite, a set of extensions to Vega-Lite that model animated visualizations as time-varying data queries. In contrast to alternate approaches for specifying animated visualizations, which prize a highly expressive…

Human-Computer Interaction · Computer Science 2022-08-15 Jonathan Zong , Josh Pollock , Dylan Wootton , Arvind Satyanarayan

The increasing integration of Visual Language Models (VLMs) into visualization systems demands a comprehensive understanding of their visual interpretation capabilities and constraints. While existing research has examined individual…

Human-Computer Interaction · Computer Science 2025-03-24 Saugat Pandey , Alvitta Ottley

Often, the needs and visual abilities differ between the annotator group and the end user group. Generating detailed diagram descriptions for blind and low-vision (BLV) users is one such challenging domain. Sighted annotators could describe…

Artificial Intelligence · Computer Science 2025-03-18 Wan Ju Kang , Eunki Kim , Na Min An , Sangryul Kim , Haemin Choi , Ki Hoon Kwak , James Thorne

Teachers of the visually impaired (TVIs) regularly present tactile materials (tactile graphics, 3D models, and real objects) to students with vision impairments. Researchers have been increasingly interested in designing tools to support…

Human-Computer Interaction · Computer Science 2022-02-25 Mahika Phutane , Julie Wright , Brenda Veronica Castro , Lei Shi , Simone R. Stern , Holly M. Lawson , Shiri Azenkot

Tactile displays have a wide potential field of applications, ranging from enhancing Virtual-Reality scenarios up to aiding telesurgery as well as in fundamental psychological and neurophysiological research. In this paper, we describe an…

Human-Computer Interaction · Computer Science 2018-04-25 Andreas Tarnowsky , Jan Jamaszyk , Daniel Brandes , Franz-Erich Wolter

Charts are ubiquitous as they help people understand and reason with data. Recently, various downstream tasks, such as chart question answering, chart2text, and fact-checking, have emerged. Large Vision-Language Models (LVLMs) show promise…

Despite widespread use, charts remain largely inaccessible for Low-Vision Individuals (LVI). Reading charts requires viewing data points within a global context, which is difficult for LVI who may rely on magnification or experience a…

Human-Computer Interaction · Computer Science 2026-03-04 Yotam Sechayk , Hennes Rave , Max Rädler , Mark Colley , Zhongyi Zhou , Ariel Shamir , Takeo Igarashi