English
Related papers

Related papers: VizAbility: Enhancing Chart Accessibility with LLM…

200 papers

Data visualization is essential for interpreting complex datasets, yet traditional tools often require technical expertise, limiting accessibility. VizGen is an AI-assisted graph generation system that empowers users to create meaningful…

Data visualizations are typically not accessible to blind and low-vision (BLV) users. Automatically generating text descriptions offers an enticing mechanism for democratizing access to the information held in complex scientific charts, yet…

Human-Computer Interaction · Computer Science 2025-03-25 Andrew McNutt , Maggie K McCracken , Ishrat Jahan Eliza , Daniel Hajas , Jake Wagoner , Nate Lanza , Jack Wilburn , Sarah Creem-Regehr , Alexander Lex

Charts play a vital role in data visualization, understanding data patterns, and informed decision-making. However, their unique combination of graphical elements (e.g., bars, lines) and textual components (e.g., labels, legends) poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Fanqing Meng , Wenqi Shao , Quanfeng Lu , Peng Gao , Kaipeng Zhang , Yu Qiao , Ping Luo

Chart understanding presents a unique challenge for large vision-language models (LVLMs), as it requires the integration of sophisticated textual and visual reasoning capabilities. However, current LVLMs exhibit a notable imbalance between…

This paper provides a comprehensive review of the integration of Large Language Models (LLMs) with visual analytics, addressing their foundational concepts, capabilities, and wide-ranging applications. It begins by outlining the theoretical…

Human-Computer Interaction · Computer Science 2025-03-20 Navya Sonal Agarwal , Sanjay Kumar Sonbhadra

Charts are ubiquitous as they help people understand and reason with data. Recently, various downstream tasks, such as chart question answering, chart2text, and fact-checking, have emerged. Large Vision-Language Models (LVLMs) show promise…

The explosion of data in recent years is driving individuals to leverage technology to generate insights. Traditional tools bring heavy learning overheads and the requirement for understanding complex charting techniques. Such barriers can…

Human-Computer Interaction · Computer Science 2023-03-28 Paula Maddigan , Teo Susnjak

Multimodal large language models (MLLMs) have been integrated into visual interpretation applications to support Blind and Low Vision (BLV) users because of their accuracy and ability to provide rich, human-like interpretations. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Ricardo Gonzalez Penuela , Felipe Arias-Russi , Victor Capriles

Despite the ubiquity of visualization examples published on the web, retargeting existing custom chart implementations to new datasets remains difficult, time-intensive, and tedious. The adaptation process assumes author familiarity with…

Human-Computer Interaction · Computer Science 2026-01-21 Luke S. Snyder , Chenglong Wang , Steven M. Drucker

Making a good graphic that accurately and efficiently conveys the desired message to the audience is both an art and a science, typically not taught in the data science curriculum. Visualisation makeovers are exercises where the community…

Human-Computer Interaction · Computer Science 2025-08-11 Siddharth Gangwar , David A. Selby , Sebastian J. Vollmer

Chart summarization, which focuses on extracting key information from charts and interpreting it in natural language, is crucial for generating and delivering insights through effective and accessible data analysis. Traditional methods for…

Multimedia · Computer Science 2024-12-31 Peixin Xu , Yujuan Ding , Wenqi Fan

We present a method for augmenting a Large Language Model (LLM) with a combination of text and visual data to enable accurate question answering in visualization of scientific data, making conversational visualization possible. LLMs…

Human-Computer Interaction · Computer Science 2025-01-17 Omar Mena , Alexandre Kouyoumdjian , Lonni Besançon , Michael Gleicher , Ivan Viola , Anders Ynnerman

Chart summarization is crucial for enhancing data accessibility and the efficient consumption of information. However, existing methods, including those with Multimodal Large Language Models (MLLMs), primarily focus on low-level data…

Artificial Intelligence · Computer Science 2026-02-24 Yuhang Bai , Yujuan Ding , Shanru Lin , Wenqi Fan

We investigate whether tactile charts support comprehension and learning of complex visualizations for blind and low-vision (BLV) individuals and contribute four tactile chart designs and an interview study. Visualizations are powerful…

Human-Computer Interaction · Computer Science 2025-08-11 Tingying He , Maggie McCracken , Daniel Hajas , Sarah Creem-Regehr , Alexander Lex

Data visualizations are central to scientific communication, journalism, and everyday decision-making, yet they are frequently prone to errors that can distort interpretation or mislead audiences. Rule-based visualization linters can flag…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Valentin Bonas , Martin Sinnona , Viviana Siless , Emmanuel Iarussi

We explore the integration of large language models (LLMs) into visual analytics (VA) systems to transform their capabilities through intuitive natural language interactions. We survey current research directions in this emerging field,…

Human-Computer Interaction · Computer Science 2025-07-01 Maeve Hutchinson , Radu Jianu , Aidan Slingsby , Pranava Madhyastha

Large language models (LLMs) have shown promise in table Question Answering (Table QA). However, extending these capabilities to multi-table QA remains challenging due to unreliable schema linking across complex tables. Existing methods…

Artificial Intelligence · Computer Science 2025-11-25 Xixi Wang , Miguel Costa , Jordanka Kovaceva , Shuai Wang , Francisco C. Pereira

In this study, we propose a solution based on a multi-agent LLM architecture and a voice user interface (VUI) designed to update the knowledge base of a digital assistant. Its usability is evaluated in comparison to a more traditional…

Human-Computer Interaction · Computer Science 2025-05-29 Grzegorz Wolny , Michał Szczerbak

Combining conversational AI with refreshable tactile displays (RTDs) offers significant potential for creating accessible data visualization for people who are blind or have low vision (BLV). To support researchers and developers building…

Human-Computer Interaction · Computer Science 2026-02-18 Samuel Reinders , Munazza Zaib , Matthew Butler , Bongshin Lee , Ingrid Zukerman , Lizhen Qu , Kim Marriott

Current video analytics approaches face a fundamental trade-off between flexibility and efficiency. End-to-end Vision Language Models (VLMs) often struggle with long-context processing and incur high computational costs, while…

Databases · Computer Science 2025-05-28 Xiangru Jian , Wei Pang , Zhengyuan Dong , Chao Zhang , M. Tamer Özsu