English
Related papers

Related papers: Tools and Tasks in Sensemaking: A Visual Accessibi…

200 papers

Multimodal Large Language Models (MLLMs) are increasingly used to interpret visualizations, yet little is known about why they fail. We present the first systematic analysis of barriers to visualization literacy in MLLMs. Using the…

Human-Computer Interaction · Computer Science 2026-01-21 Mengli , Duan , Yuhe , Jiang , Matthew Varona , Carolina Nobre

Narrative sensemaking is a fundamental process to understand sequential information. Narrative maps are a visual representation framework that can aid analysts in their narrative sensemaking process. Narrative maps allow analysts to…

Human-Computer Interaction · Computer Science 2021-12-24 Brian Felipe Keith Norambuena , Tanushree Mitra , Chris North

This paper explores capabilities of Vision Language Models on spreadsheet comprehension. We propose three self-supervised challenges with corresponding evaluation metrics to comprehensively evaluate VLMs on Optical Character Recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Shiyu Xia , Junyu Xiong , Haoyu Dong , Jianbo Zhao , Yuzhang Tian , Mengyu Zhou , Yeye He , Shi Han , Dongmei Zhang

We introduce InterChart, a diagnostic benchmark that evaluates how well vision-language models (VLMs) reason across multiple related charts, a task central to real-world applications such as scientific reporting, financial analysis, and…

Computation and Language · Computer Science 2026-05-04 Anirudh Iyengar Kaniyar Narayana Iyengar , Srija Mukhopadhyay , Adnan Qidwai , Shubhankar Singh , Dan Roth , Vivek Gupta

A system that enables blind or visually impaired users to access comics/manga would introduce a new medium of storytelling to this community. However, no such system currently exists. Generative vision-language models (VLMs) have shown…

Vision-language models (VLMs) have gained widespread adoption in both industry and academia. In this study, we propose a unified framework for systematically evaluating gender, race, and age biases in VLMs with respect to professions. Our…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Ashutosh Sathe , Prachi Jain , Sunayana Sitaram

Modelling information from complex systems such as humans social interaction or words co-occurrences in our languages can help to understand how these systems are organized and function. Such systems can be modelled by networks, and network…

Computation and Language · Computer Science 2024-12-12 Thibault Prouteau , Nicolas Dugué , Simon Guillot

How audiences read, interpret, and critique data visualizations is mainly assessed through performance tests featuring tasks like value retrieval. Yet, other factors shown to shape visualization understanding, such as numeracy, graph…

Human-Computer Interaction · Computer Science 2025-11-04 Antonia Saske , Laura Koesten , Torsten Möller , Judith Staudner , Sylvia Kritzinger

The ubiquitous presence of smartphones and wearables has enabled researchers to build prediction and detection models for various health and behavior outcomes using passive sensing data from these devices. Achieving a high-level, holistic…

Human-Computer Interaction · Computer Science 2025-07-23 Akshat Choube , Ha Le , Jiachen Li , Kaixin Ji , Vedant Das Swain , Varun Mishra

We investigate the ability of Vision Language Models (VLMs) to perform visual perspective taking using a new set of visual tasks inspired by established human tests. Our approach leverages carefully controlled scenes in which a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Gracjan Góral , Alicja Ziarko , Piotr Miłoś , Michał Nauman , Maciej Wołczyk , Michał Kosiński

We introduce ChartA11y, an app developed to enable accessible 2-D visualizations on smartphones for blind users through a participatory and iterative design process involving 13 sessions with two blind partners. We also present a design…

Human-Computer Interaction · Computer Science 2024-10-29 Zhuohao Jerry Zhang , John R. Thompson , Aditi Shah , Manish Agrawal , Alper Sarikaya , Jacob O. Wobbrock , Edward Cutrell , Bongshin Lee

With the advent of the data era, and of new, more intelligent interfaces for supporting decision making, there is a growing need to define, model and assess human ability and data visualizations usability for a better encoding and decoding…

Human-Computer Interaction · Computer Science 2025-03-19 Sara Beschi , Davide Falessi , Silvia Golia , Angela Locoro

Assistive agents for Blind and Visually Impaired (BVI) users require accessibility alignment as a first-class design objective. Despite rapid progress in agentic AI, most systems are designed and evaluated under assumptions of sighted…

Artificial Intelligence · Computer Science 2026-05-14 Jie Hu , Changyuan Yan , Yu Zheng , Ziqian Wang , Jiaming Zhang

The ability to read, understand, and comprehend visual information representations is subsumed under the term visualization literacy (VL). One possibility to improve the use of information visualizations is to introduce adaptations.…

Human-Computer Interaction · Computer Science 2022-07-18 Marc Satkowski , Franziska Kessler , Susanne Narciss , Raimund Dachselt

Well-designed indoor scenes should prioritize how people can act within a space rather than merely what objects to place. However, existing 3D scene generation methods emphasize visual and semantic plausibility, while insufficiently…

Human-Computer Interaction · Computer Science 2026-03-04 Semin Jin , Donghyuk Kim , Jeongmin Ryu , Kyung Hoon Hyun

Navigation in new or unknown environments is vital, especially for visually impaired individuals. While many solutions exist, few are tailored to specific disabilities, often due to limited collaboration with handicap users in the design…

Human-Computer Interaction · Computer Science 2025-11-18 Eduardo Augusto Monteiro de Almeida , Guillaume Thomann , Angelina Dias Leão Costa

While people with visual impairments are interested in artwork as much as their sighted peers, their experience is limited to few selective artworks that are exhibited at certain museums. To enable people with visual impairments to access…

Human-Computer Interaction · Computer Science 2021-03-03 Nahyun Kwon , Yunjung Lee , Uran Oh

We present drillboards, a technique for adaptive visualization dashboards consisting of a hierarchy of coordinated charts that the user can drill down to reach a desired level of detail depending on their expertise, interest, and desired…

Human-Computer Interaction · Computer Science 2025-02-18 Sungbok Shin , Inyoup Na , Niklas Elmqvist

3D layout tasks have traditionally concentrated on geometric constraints, but many practical applications demand richer contextual understanding that spans social interactions, cultural traditions, and usage conventions. Existing methods…

Graphics · Computer Science 2025-04-01 Yuto Asano , Naruya Kondo , Tatsuki Fushimi , Yoichi Ochiai

No two people are alike. We usually ignore this diversity as we have the capability to adapt and, without noticing, become experts in interfaces that were probably misadjusted to begin with. This adaptation is not always at the user's…

Human-Computer Interaction · Computer Science 2014-02-06 Tiago Guerreiro , Hugo Nicolau , João Oliveira , Joaquim Jorge , Daniel Gonçalves