English
Related papers

Related papers: ChartMaster: Advancing Chart-to-Code Generation wi…

200 papers

The capabilities of Large Vision-Language Models (LVLMs) have reached state-of-the-art on many visual reasoning tasks, including chart reasoning, yet they still falter on out-of-distribution (OOD) data, and degrade further when asked to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Sanchit Sinha , Oana Frunza , Kashif Rasul , Yuriy Nevmyvaka , Aidong Zhang

Chart editing reduces manual effort in visualization design. Typical benchmarks limited in data diversity and assume access to complete chart code, which is seldom in real-world scenarios. To address this gap, we present ChartEditVista, a…

Multimedia · Computer Science 2025-11-20 Liangyu Chen , Yichen Xu , Jianzhe Ma , Yuqi Liu , Donglu Yang , Liang Zhang , Wenxuan Wang , Qin Jin

In this work, we address the task of table image to LaTeX code generation, with the goal of automating the reconstruction of high-quality, publication-ready tables from visual inputs. A central challenge of this task lies in accurately…

Artificial Intelligence · Computer Science 2025-09-23 Jun Ling , Yao Qi , Tao Huang , Shibo Zhou , Yanqin Huang , Jiang Yang , Ziqi Song , Ying Zhou , Yang Yang , Heng Tao Shen , Peng Wang

Large Language Models (LLMs) exhibit remarkable code generation capabilities but falter when adapting to frequent updates in external library APIs. This critical limitation, stemming from reliance on outdated API knowledge from their…

Computation and Language · Computer Science 2025-11-25 Haoze Wu , Yunzhi Yao , Wenhao Yu , Ningyu Zhang

Chart reasoning presents unique challenges due to its inherent complexity -- requiring precise numerical comprehension, multi-level visual understanding, and logical inference across interconnected data elements. Existing vision-language…

Artificial Intelligence · Computer Science 2026-03-17 Lei Chen , Xuanle Zhao , Zhixiong Zeng , Jing Huang , Yufeng Zhong , Lin Ma

Text-to-Visualization (Text2Vis) systems translate natural language queries over tabular data into concise answers and executable visualizations. While closed-source LLMs generate functional code, the resulting charts often lack semantic…

Computation and Language · Computer Science 2026-01-09 Mizanur Rahman , Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

Although multimodal large language models (MLLMs) show promise in generating chart rendering code, editing charts via code presents a greater challenge. This task demands MLLMs to integrate chart understanding and reasoning capacities,…

Computation and Language · Computer Science 2025-08-05 Xuanle Zhao , Xuexin Liu , Haoyue Yang , Xianzhen Luo , Fanhu Zeng , Jianling Li , Qi Shi , Chi Chen

Vision-Language Models (VLMs) have shown promise in generating plotting code from chart images, yet achieving structural fidelity remains challenging. Existing approaches largely rely on supervised fine-tuning, encouraging surface-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Minggui He , Mingchen Dai , Jian Zhang , Yilun Liu , Shimin Tao , Pufan Zeng , Osamu Yoshie , Yuya Ieiri

Charts are ubiquitous in scientific and financial literature for presenting structured data. However, chart reasoning remains challenging for multimodal large language models (MLLMs) due to the lack of high-quality training data, as well as…

Artificial Intelligence · Computer Science 2026-04-06 Situo Zhang , Yifan Zhang , Zichen Zhu , Da Ma , Lei Pan , Danyang Zhang , Zihan Zhao , Lu Chen , Kai Yu

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Mingrui Wu , Lu Wang , Pu Zhao , Fangkai Yang , Jianjin Zhang , Jianfeng Liu , Yuefeng Zhan , Weihao Han , Hao Sun , Jiayi Ji , Xiaoshuai Sun , Qingwei Lin , Weiwei Deng , Dongmei Zhang , Feng Sun , Qi Zhang , Rongrong Ji

Chart question answering (ChartQA) tasks play a critical role in interpreting and extracting insights from visualization charts. While recent advancements in multimodal large language models (MLLMs) like GPT-4o have shown promise in…

Computation and Language · Computer Science 2024-11-07 Yifan Wu , Lutao Yan , Leixian Shen , Yunhai Wang , Nan Tang , Yuyu Luo

Designing effective reward functions remains a major challenge in reinforcement learning (RL), often requiring considerable human expertise and iterative refinement. Recent advances leverage Large Language Models (LLMs) for automated reward…

Robotics · Computer Science 2026-03-26 Changwei Yao , Xinzi Liu , Chen Li , Marios Savvides

Decoding-based regression, which reformulates regression as a sequence generation task, has emerged as a promising paradigm of applying large language models for numerical prediction. However, its progress is hindered by the misalignment…

Machine Learning · Computer Science 2025-12-09 Ming Chen , Sheng Tang , Rong-Xi Tan , Ziniu Li , Jiacheng Chen , Ke Xue , Chao Qian

Chart understanding presents a critical test to the reasoning capabilities of Vision-Language Models (VLMs). Prior approaches face critical limitations: some rely on external tools, making them brittle and constrained by a predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Bohao Tang , Yan Ma , Fei Zhang , Jiadi Su , Ethan Chern , Zhulin Hu , Zhixin Wang , Pengfei Liu , Ya Zhang

With the rapid advancement of data science, charts have evolved from simple numerical presentation tools to essential instruments for insight discovery and decision-making support. However, current chart data intelligence exhibits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiajin Tang , Gaoyang , Wenjie Wang , Sibei Yang , Xing Chen

Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured representations with high visual fidelity. While recent Large Vision Language Models (LVLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ziyu Liu , Shengyuan Ding , Xinyu Fang , Xuanlang Dai , Penghui Yang , Jianze Liang , Jiaqi Wang , Kai Chen , Dahua Lin , Yuhang Zang

Despite the ubiquity of visualization examples published on the web, retargeting existing custom chart implementations to new datasets remains difficult, time-intensive, and tedious. The adaptation process assumes author familiarity with…

Human-Computer Interaction · Computer Science 2026-01-21 Luke S. Snyder , Chenglong Wang , Steven M. Drucker

Large Language Models (LLMs) are changing the coding paradigm, known as vibe coding, yet synthesizing algorithmically sophisticated and robust code still remains a critical challenge. Incentivizing the deep reasoning capabilities of LLMs is…

Computation and Language · Computer Science 2026-02-18 Chansung Park , Juyong Jiang , Fan Wang , Sayak Paul , Jiasi Shen , Jing Tang , Jianguo Li

Chart understanding is crucial for deploying multimodal large language models (MLLMs) in real-world scenarios such as analyzing scientific papers and technical reports. Unlike natural images, charts pair a structured visual layout (spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Zhuoming Liu , Xiaofeng Gao , Feiyang Niu , Qiaozi Gao , Liu Liu , Robinson Piramuthu

The use of natural language interfaces (NLIs) to create charts is becoming increasingly popular due to the intuitiveness of natural language interactions. One key challenge in this approach is to accurately capture user intents and…

Human-Computer Interaction · Computer Science 2025-01-22 Yuan Tian , Weiwei Cui , Dazhen Deng , Xinjing Yi , Yurun Yang , Haidong Zhang , Yingcai Wu