English
Related papers

Related papers: Automated Visualization Makeovers with LLMs

200 papers

We propose a novel framework that leverages Visual Question Answering (VQA) models to automate the evaluation of LLM-generated data visualizations. Traditional evaluation methods often rely on human judgment, which is costly and unscalable,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 James Ford , Xingmeng Zhao , Dan Schumacher , Anthony Rios

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

Data visualization principles, derived from decades of research in design and perception, ensure proper visual communication. While prior work has shown that large language models (LLMs) can generate charts or flag misleading figures, it…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Martin Sinnona , Valentin Bonas , Viviana Siless , Emmanuel Iarussi

Generating accurate and consistent visual aids is a critical challenge in mathematics education, where visual representations like geometric shapes and functions play a pivotal role in enhancing student comprehension. This paper introduces…

Computation and Language · Computer Science 2024-11-11 Jeongwoo Lee , Kwangsuk Park , Jihyeon Park

Visualizations play a pivotal role in daily communication in an increasingly data-driven world. Research on multimodal large language models (MLLMs) for automated chart understanding has accelerated massively, with steady improvements on…

Computation and Language · Computer Science 2026-04-20 Jonathan Tonglet , Tinne Tuytelaars , Marie-Francine Moens , Iryna Gurevych

Scientific data visualization is pivotal for transforming raw data into comprehensible visual representations, enabling pattern recognition, forecasting, and the presentation of data-driven insights. However, novice users often face…

Computation and Language · Computer Science 2025-02-04 Kanika Goswami , Puneet Mathur , Ryan Rossi , Franck Dernoncourt

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

Machine Learning · Computer Science 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Large language models (LLMs) have gained increasing popularity in robotic task planning due to their exceptional abilities in text analytics and generation, as well as their broad knowledge of the world. However, they fall short in decoding…

Robotics · Computer Science 2024-08-01 Aoran Mei , Guo-Niu Zhu , Huaxiang Zhang , Zhongxue Gan

Interactive visualization editors empower users to author visualizations without writing code, but do not provide guidance on the art and craft of effective visual communication. In this paper, we explore the potential of using an…

Human-Computer Interaction · Computer Science 2025-06-13 Sungbok Shin , Sanghyun Hong , Niklas Elmqvist

We present a method for augmenting a Large Language Model (LLM) with a combination of text and visual data to enable accurate question answering in visualization of scientific data, making conversational visualization possible. LLMs…

Human-Computer Interaction · Computer Science 2025-01-17 Omar Mena , Alexandre Kouyoumdjian , Lonni Besançon , Michael Gleicher , Ivan Viola , Anders Ynnerman

Scientific data visualization plays a crucial role in research by enabling the direct display of complex information and assisting researchers in identifying implicit patterns. Despite its importance, the use of Large Language Models (LLMs)…

Computation and Language · Computer Science 2024-03-20 Zhiyu Yang , Zihan Zhou , Shuo Wang , Xin Cong , Xu Han , Yukun Yan , Zhenghao Liu , Zhixing Tan , Pengyuan Liu , Dong Yu , Zhiyuan Liu , Xiaodong Shi , Maosong Sun

Various human-designed prompt engineering techniques have been proposed to improve problem solvers based on Large Language Models (LLMs), yielding many disparate code bases. We unify these approaches by describing LLM-based agents as…

Artificial Intelligence · Computer Science 2024-08-23 Mingchen Zhuge , Wenyi Wang , Louis Kirsch , Francesco Faccio , Dmitrii Khizbullin , Jürgen Schmidhuber

As the performance of Large-scale Vision Language Models (LVLMs) improves, they are increasingly capable of responding in multiple languages, and there is an expectation that the demand for explanations generated by LVLMs will grow.…

Computation and Language · Computer Science 2025-02-17 Shintaro Ozaki , Kazuki Hayashi , Yusuke Sakai , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

In this study, we address the growing issue of misleading charts, a prevalent problem that undermines the integrity of information dissemination. Misleading charts can distort the viewer's perception of data, leading to misinterpretations…

Human-Computer Interaction · Computer Science 2024-07-25 Leo Yu-Ho Lo , Huamin Qu

Large Language Models (LLMs) have revolutionized natural language processing and demonstrated impressive capabilities in various tasks. Unfortunately, they are prone to hallucinations, where the model exposes incorrect or false information…

Computation and Language · Computer Science 2023-10-13 Patrik Puchert , Poonam Poonam , Christian van Onzenoodt , Timo Ropinski

Large language models (LLMs) have made significant advancements in natural language understanding. However, through that enormous semantic representation that the LLM has learnt, is it somehow possible for it to understand images as well?…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Mu Cai , Zeyi Huang , Yuheng Li , Utkarsh Ojha , Haohan Wang , Yong Jae Lee

Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context,…

Human-Computer Interaction · Computer Science 2023-03-17 Sara Di Bartolomeo , Giorgio Severi , Victor Schetinger , Cody Dunne

Property graphs are widely used in domains such as healthcare, finance, and social networks, but they often contain errors due to inconsistencies, missing data, or schema violations. Traditional rule-based and heuristic-driven graph repair…

Computation and Language · Computer Science 2025-07-08 Hrishikesh Terdalkar , Angela Bonifati , Andrea Mauri

We explore the integration of large language models (LLMs) into visual analytics (VA) systems to transform their capabilities through intuitive natural language interactions. We survey current research directions in this emerging field,…

Human-Computer Interaction · Computer Science 2025-07-01 Maeve Hutchinson , Radu Jianu , Aidan Slingsby , Pranava Madhyastha

Large Language Models have rapidly advanced in their ability to interpret and generate natural language. In enterprise settings, they are frequently augmented with closed-source domain knowledge to deliver more contextually informed…

Computation and Language · Computer Science 2025-12-03 Tanmay Agrawal