English
Related papers

Related papers: Accessible Text Descriptions for UpSet Plots

200 papers

Set systems are used to model data that naturally arises in many contexts: social networks have communities, musicians have genres, and patients have symptoms. Visualizations that accurately reflect the information in the underlying set…

Human-Computer Interaction · Computer Science 2022-02-17 Markus Wallinger , Ben Jacobsen , Stephen Kobourov , Martin Nöllenburg

Multimodal large language models (MLLMs) are changing how Blind and Low Vision (BLV) people access visual information. Unlike traditional visual interpretation tools that only provide descriptions, MLLM-enabled applications offer…

Human-Computer Interaction · Computer Science 2026-02-20 Ricardo E. Gonzalez Penuela , Crescentia Jung , Sharon Y Lin , Ruiying Hu , Shiri Azenkot

Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language Models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to…

Software Engineering · Computer Science 2025-06-16 Saadiq Rauf Khan , Vinit Chandak , Sougata Mukherjea

In this work, we research user preferences to see a chart, table, or text given a question asked by the user. This enables us to understand when it is best to show a chart, table, or text to the user for the specific question. For this, we…

Human-Computer Interaction · Computer Science 2024-11-13 Reuben Luera , Ryan Rossi , Franck Dernoncourt , Alexa Siu , Sungchul Kim , Tong Yu , Ruiyi Zhang , Xiang Chen , Nedim Lipka , Zhehao Zhang , Seon Gyeom Kim , Tak Yeon Lee

Large language models (LLMs) have shown impressive performance on general-purpose tasks, yet adapting them to specific domains remains challenging due to the scarcity of high-quality domain data. Existing data synthesis tools often struggle…

Computation and Language · Computer Science 2025-07-08 Ziyang Miao , Qiyu Sun , Jingyuan Wang , Yuchen Gong , Yaowei Zheng , Shiqi Li , Richong Zhang

We present drillboards, a technique for adaptive visualization dashboards consisting of a hierarchy of coordinated charts that the user can drill down to reach a desired level of detail depending on their expertise, interest, and desired…

Human-Computer Interaction · Computer Science 2025-02-18 Sungbok Shin , Inyoup Na , Niklas Elmqvist

Recently, many versatile Multi-modal Large Language Models (MLLMs) have emerged continuously. However, their capacity to query information depicted in visual charts and engage in reasoning based on the queried contents remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Renqiu Xia , Bo Zhang , Hancheng Ye , Xiangchao Yan , Qi Liu , Hongbin Zhou , Zijun Chen , Peng Ye , Min Dou , Botian Shi , Junchi Yan , Yu Qiao

In scientific research and its application, scientific literature analysis is crucial as it allows researchers to build on the work of others. However, the fast growth of scientific knowledge has led to a massive increase in scholarly…

Generating diverse, readable statistical charts from tabular data remains challenging for LLMs, as many failures become apparent after rendering and are not detectable from data or code alone. Existing chart datasets also rarely provide…

Machine Learning · Computer Science 2026-05-04 Pavlin G. Poličar , Andraž Pevcin , Blaž Zupan

Charts effectively convey quantitative information, but the underlying data are often locked in image form, hindering reuse and analysis. Manually digitizing charts is time-consuming and error-prone, motivating automatic chart-to-table…

Computation and Language · Computer Science 2026-05-27 Thomas Berkane , Qianyi Wang , Maimuna S. Majumder

With the growing capabilities of Large Language Models (LLMs), there is an increasing need for robust evaluation methods, especially in multilingual and non-English contexts. We present an updated version of the BLUEX dataset, now including…

Computation and Language · Computer Science 2025-09-01 João Guilherme Alves Santos , Giovana Kerche Bonás , Thales Sales Almeida

Vision-Language Models (VLMs) have shown promise in generating plotting code from chart images, yet achieving structural fidelity remains challenging. Existing approaches largely rely on supervised fine-tuning, encouraging surface-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Minggui He , Mingchen Dai , Jian Zhang , Yilun Liu , Shimin Tao , Pufan Zeng , Osamu Yoshie , Yuya Ieiri

New tactile interfaces such as swell form printing or refreshable tactile displays promise to allow visually impaired people to analyze data. However, it is possible that design guidelines and familiar encodings derived from experiments on…

Human-Computer Interaction · Computer Science 2024-10-14 Areen Khalaila , Lane Harrison , Nam Wook Kim , Dylan Cashman

Education that suits the individual learning level is necessary to improve students' understanding. The first step in achieving this purpose by using large language models (LLMs) is to adjust the textual difficulty of the response to…

Computation and Language · Computer Science 2024-02-23 Seiji Gobara , Hidetaka Kamigaito , Taro Watanabe

Assessing the accessibility of unfamiliar built environments is critical for people with disabilities. However, manual assessments, performed by users or their personal health professionals, are laborious and unscalable, while automatic…

Human-Computer Interaction · Computer Science 2026-01-23 William Huang , Xia Su , Jon E. Froehlich , Yang Zhang

While visualizations are an effective way to represent insights about information, they rarely stand alone. When designing a visualization, text is often added to provide additional context and guidance for the reader. However, there is…

Human-Computer Interaction · Computer Science 2022-09-23 Chase Stokes , Vidya Setlur , Bridget Cogley , Arvind Satyanarayan , Marti Hearst

Large language models (LLMs) have recently soared in popularity due to their ease of access and the unprecedented ability to synthesize text responses to diverse user questions. However, LLMs like ChatGPT present significant limitations in…

Human-Computer Interaction · Computer Science 2023-08-08 Peiling Jiang , Jude Rayan , Steven P. Dow , Haijun Xia

Automated chart summarization is crucial for enhancing data accessibility and enabling efficient information extraction from visual data. While recent advances in visual-language models (VLMs) have demonstrated promise, existing methods…

Computation and Language · Computer Science 2025-02-26 Raymond Choi , Frank Burns , Chase Lawrence

Large Vision-Language Models (LVLMs) have transformed image captioning, shifting from concise captions to detailed descriptions. We introduce LOTUS, a leaderboard for evaluating detailed captions, addressing three main gaps in existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yusuke Hirota , Boyi Li , Ryo Hachiuma , Yueh-Hua Wu , Boris Ivanovic , Yuta Nakashima , Marco Pavone , Yejin Choi , Yu-Chiang Frank Wang , Chao-Han Huck Yang

Compound graphs are networks in which vertices can be grouped into larger subsets, with these subsets capable of further grouping, resulting in a nesting that can be many levels deep. In several applications, including biological workflows,…

Human-Computer Interaction · Computer Science 2024-08-09 Chang Han , Justin Lieffers , Clayton Morrison , Katherine E. Isaacs