English
Related papers

Related papers: PlotGen: Multi-Agent LLM-based Scientific Data Vis…

200 papers

We present VizGenie, a self-improving, agentic framework that advances scientific visualization through large language model (LLM) by orchestrating of a collection of domain-specific and dynamically generated modules. Users initially access…

AutoGen is an open-source framework that allows developers to build LLM applications via multiple agents that can converse with each other to accomplish tasks. AutoGen agents are customizable, conversable, and can operate in various modes…

Recent advances in large language models (LLMs) have enabled agentic systems that translate natural language intent into executable scientific visualization (SciVis) tasks. Despite rapid progress, the community lacks a principled and…

Large Language Model (LLM)-based agents have shown effectiveness across many applications. However, their use in data science scenarios requiring solving long-term interconnected tasks, dynamic data adjustments and domain expertise remains…

Generating academic slides from scientific papers is a challenging multimodal reasoning task that requires both long context understanding and deliberate visual planning. Existing approaches largely reduce it to text only summarization,…

Artificial Intelligence · Computer Science 2025-12-10 Xin Liang , Xiang Zhang , Yiwei Xu , Siqi Sun , Chenyu You

Data-driven storytelling is a powerful method for conveying insights by combining narrative techniques with visualizations and text. These stories integrate visual aids, such as highlighted bars and lines in charts, along with textual…

Computation and Language · Computer Science 2024-10-07 Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Md Rizwan Parvez , Enamul Hoque , Shafiq Joty

In recent years, Large Language Models (LLMs) have achieved remarkable progress in automated code generation. In real-world software engineering, the growing demand for rapid iteration and continuous delivery underscores the importance of…

Software Engineering · Computer Science 2025-11-06 Qianhui Zhao , Li Zhang , Fang Liu , Junhang Cheng , Chengru Wu , Junchen Ai , Qiaoyuanhe Meng , Lichen Zhang , Xiaoli Lian , Shubin Song , Yuanping Guo

This paper introduces the human-curated PandasPlotBench dataset, designed to evaluate language models' effectiveness as assistants in visual data exploration. Our benchmark focuses on generating code for visualizing tabular data - such as a…

Software Engineering · Computer Science 2025-02-27 Timur Galimzyanov , Sergey Titov , Yaroslav Golubev , Egor Bogomolov

Fine-tuning for large language models (LLMs) typically requires substantial amounts of high-quality supervised data, which is both costly and labor-intensive to acquire. While synthetic data generation has emerged as a promising solution,…

Computation and Language · Computer Science 2025-05-28 Zihong Chen , Wanli Jiang , Jinzhe Li , Zhonghang Yuan , Huanjun Kong , Wanli Ouyang , Nanqing Dong

Visualization is central to scientific discovery, yet authoring tools remain split between information and scientific visualization, and expertise in one rarely transfers to the other. Large Language Model (LLM) based systems promise to…

Human-Computer Interaction · Computer Science 2026-04-14 Alexandra Irger , Ella Hugie , Minghao Guo , Simon Warchol , Kenneth Moreland , David Pugmire , Wojciech Matusik , Hanspeter Pfister

Deep research has revolutionized data analysis, yet data scientists still devote substantial time to manually crafting visualizations, highlighting the need for robust automation from natural language queries. However, current systems…

Artificial Intelligence · Computer Science 2025-10-06 Zichen Chen , Jiefeng Chen , Sercan Ö. Arik , Misha Sra , Tomas Pfister , Jinsung Yoon

LLMs are increasingly deployed as agents, systems capable of planning, reasoning, and dynamically calling external tools. However, in visual reasoning, prior approaches largely remain limited by predefined workflows and static toolsets. In…

Computation and Language · Computer Science 2025-08-28 Shitian Zhao , Haoquan Zhang , Shaoheng Lin , Ming Li , Qilong Wu , Kaipeng Zhang , Chen Wei

Multi-agent systems built upon large language models (LLMs) have demonstrated remarkable capabilities in tackling complex compositional tasks. In this work, we apply this paradigm to the paper-to-poster generation problem, a practical yet…

Artificial Intelligence · Computer Science 2026-04-14 Zhilin Zhang , Xiang Zhang , Jiaqi Wei , Yiwei Xu , Chenyu You

Tool use has turned large language models (LLMs) into powerful agents that can perform complex multi-step tasks by dynamically utilising external software components. However, these tools must be implemented in advance by human developers,…

Computation and Language · Computer Science 2025-06-02 Georg Wölflein , Dyke Ferber , Daniel Truhn , Ognjen Arandjelović , Jakob Nikolas Kather

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

Chart generation aims to generate code to produce charts satisfying the desired visual properties, e.g., texts, layout, color, and type. It has great potential to empower the automatic professional report generation in financial analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Bingxuan Li , Yiwei Wang , Jiuxiang Gu , Kai-Wei Chang , Nanyun Peng

This work examines the integration of large language models (LLMs) into multi-agent simulations by replacing the hard-coded programs of agents with LLM-driven prompts. The proposed approach is showcased in the context of two examples of…

Multiagent Systems · Computer Science 2025-03-07 Cristian Jimenez-Romero , Alper Yegenoglu , Christian Blum

The advancement in large language models (LLMs) and large vision models has fueled the rapid progress in multi-modal vision-language reasoning capabilities. However, existing vision-language models (VLMs) remain challenged by compositional…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Yichang Xu , Gaowen Liu , Ramana Rao Kompella , Sihao Hu , Fatih Ilhan , Selim Furkan Tekin , Zachary Yahn , Ling Liu

Accurate visual understanding is imperative for advancing autonomous systems and intelligent robots. Despite the powerful capabilities of vision-language models (VLMs) in processing complex visual scenes, precisely recognizing obscured or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Huaxiang Zhang , Yaojia Mu , Guo-Niu Zhu , Zhongxue Gan

Large Language Models have recently gained significant attention in scientific discovery for their extensive knowledge and advanced reasoning capabilities. However, they encounter challenges in effectively simulating observational feedback…

Machine Learning · Computer Science 2024-05-17 Pingchuan Ma , Tsun-Hsuan Wang , Minghao Guo , Zhiqing Sun , Joshua B. Tenenbaum , Daniela Rus , Chuang Gan , Wojciech Matusik