English
Related papers

Related papers: ChartDesign: Towards LLM Designer of Data Visualiz…

200 papers

Recently, leveraging large language models (LLMs) or multimodal large language models (MLLMs) for document understanding has been proven very promising. However, previous works that employ LLMs/MLLMs for document understanding have not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Chuwei Luo , Yufan Shen , Zhaoqing Zhu , Qi Zheng , Zhi Yu , Cong Yao

In this work, we research user preferences to see a chart, table, or text given a question asked by the user. This enables us to understand when it is best to show a chart, table, or text to the user for the specific question. For this, we…

Human-Computer Interaction · Computer Science 2024-11-13 Reuben Luera , Ryan Rossi , Franck Dernoncourt , Alexa Siu , Sungchul Kim , Tong Yu , Ruiyi Zhang , Xiang Chen , Nedim Lipka , Zhehao Zhang , Seon Gyeom Kim , Tak Yeon Lee

In this study, we address the growing issue of misleading charts, a prevalent problem that undermines the integrity of information dissemination. Misleading charts can distort the viewer's perception of data, leading to misinterpretations…

Human-Computer Interaction · Computer Science 2024-07-25 Leo Yu-Ho Lo , Huamin Qu

The field of Multimodal Large Language Models (MLLMs) has made remarkable progress in visual understanding tasks, presenting a vast opportunity to predict the perceptual and emotional impact of charts. However, it also raises concerns, as…

Human-Computer Interaction · Computer Science 2025-05-26 Seon Gyeom Kim , Jae Young Choi , Ryan Rossi , Eunyee Koh , Tak Yeon Lee

Charts are very popular for analyzing data, visualizing key insights and answering complex reasoning questions about data. To facilitate chart-based data analysis using natural language, several downstream tasks have been introduced…

Computation and Language · Computer Science 2023-10-12 Ahmed Masry , Parsa Kavehzadeh , Xuan Long Do , Enamul Hoque , Shafiq Joty

Misleading visualizations, which manipulate chart representations to support specific claims, can distort perception and lead to incorrect conclusions. Despite decades of research, they remain a widespread issue, posing risks to public…

Computation and Language · Computer Science 2025-09-23 Zixin Chen , Sicheng Song , Kashun Shum , Yanna Lin , Rui Sheng , Weiqi Wang , Huamin Qu

Chart generation aims to generate code to produce charts satisfying the desired visual properties, e.g., texts, layout, color, and type. It has great potential to empower the automatic professional report generation in financial analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Bingxuan Li , Yiwei Wang , Jiuxiang Gu , Kai-Wei Chang , Nanyun Peng

With the rapid development of large language models (LLMs) and their integration into large multimodal models (LMMs), there has been impressive progress in zero-shot completion of user-oriented vision-language tasks. However, a gap remains…

Computation and Language · Computer Science 2024-04-16 Fuxiao Liu , Xiaoyang Wang , Wenlin Yao , Jianshu Chen , Kaiqiang Song , Sangwoo Cho , Yaser Yacoob , Dong Yu

Discovering new materials can have significant scientific and technological implications but remains a challenging problem today due to the enormity of the chemical space. Recent advances in machine learning have enabled data-driven methods…

Materials Science · Physics 2024-06-21 Shuyi Jia , Chao Zhang , Victor Fung

The frequent need for analysts to create visualizations to derive insights from data has driven extensive research into the generation of natural Language to Visualization (NL2VIS). While recent progress in large language models (LLMs)…

Human-Computer Interaction · Computer Science 2025-12-12 Xinyu Wang , Chenwei Liang , Shunyuan Zheng , Jinyuan Liang , Guozheng Li , Yu Zhang , Chi Harold Liu

Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language Models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to…

Software Engineering · Computer Science 2025-06-16 Saadiq Rauf Khan , Vinit Chandak , Sougata Mukherjea

Attaining a high degree of user controllability in visual generation often requires intricate, fine-grained inputs like layouts. However, such inputs impose a substantial burden on users when compared to simple text inputs. To address the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Weixi Feng , Wanrong Zhu , Tsu-jui Fu , Varun Jampani , Arjun Akula , Xuehai He , Sugato Basu , Xin Eric Wang , William Yang Wang

Large Language Models (LLMs) have demonstrated strong capabilities in transforming text descriptions or tables to data visualizations via instruction-tuning methods. However, it is not straightforward to apply these methods directly for a…

Computation and Language · Computer Science 2025-08-28 Akriti Jain , Pritika Ramu , Aparna Garimella , Apoorv Saxena

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in image understanding and generation. However, current benchmarks fail to accurately evaluate the chart comprehension of MLLMs due to limited chart types and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zhengzhuo Xu , Sinan Du , Yiyan Qi , Chengjin Xu , Chun Yuan , Jian Guo

Automatic chart to text summarization is an effective tool for the visually impaired people along with providing precise insights of tabular data in natural language to the user. A large and well-structured dataset is always a key part for…

Computation and Language · Computer Science 2023-06-13 Raian Rahman , Rizvi Hasan , Abdullah Al Farhad , Md Tahmid Rahman Laskar , Md. Hamjajul Ashmafee , Abu Raihan Mostofa Kamal

Inspired by the recent advancements of Large Language Models (LLMs) in NLP tasks, there's growing interest in applying LLMs to graph-related tasks. This study delves into the capabilities of instruction-following LLMs for engaging with…

Computation and Language · Computer Science 2024-08-13 Kerui Zhu , Bo-Wei Huang , Bowen Jin , Yizhu Jiao , Ming Zhong , Kevin Chang , Shou-De Lin , Jiawei Han

A number of tasks have been proposed recently to facilitate easy access to charts such as chart QA and summarization. The dominant paradigm to solve these tasks has been to fine-tune a pretrained model on the task data. However, this…

Computation and Language · Computer Science 2023-12-19 Xuan Long Do , Mohammad Hassanpour , Ahmed Masry , Parsa Kavehzadeh , Enamul Hoque , Shafiq Joty

Information visualizations are powerful tools that help users quickly identify patterns, trends, and outliers, facilitating informed decision-making. However, when visualizations incorporate deceptive design elements-such as truncated or…

Computation and Language · Computer Science 2025-08-14 Ridwan Mahbub , Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Mizanur Rahman , Mir Tafseer Nayeem , Enamul Hoque

Graphs are a widely used paradigm for representing non-Euclidean data, with applications ranging from social network analysis to biomolecular prediction. While graph learning has achieved remarkable progress, real-world graph data presents…

Text logo design heavily relies on the creativity and expertise of professional designers, in which arranging element layouts is one of the most important procedures. However, this specific task has received limited attention, often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Junwen He , Yifan Wang , Lijun Wang , Huchuan Lu , Jun-Yan He , Chenyang Li , Hanyuan Chen , Jin-Peng Lan , Bin Luo , Yifeng Geng