English
Related papers

Related papers: ChartEditor: A Reinforcement Learning Framework fo…

200 papers

We present SMART-Editor, a framework for compositional layout and content editing across structured (posters, websites) and unstructured (natural images) domains. Unlike prior models that perform local edits, SMART-Editor preserves global…

Computation and Language · Computer Science 2025-08-06 Ishani Mondal , Meera Bharadwaj , Ayush Roy , Aparna Garimella , Jordan Lee Boyd-Graber

Automated data visualization plays a crucial role in simplifying data interpretation, enhancing decision-making, and improving efficiency. While large language models (LLMs) have shown promise in generating visualizations from natural…

Computation and Language · Computer Science 2025-07-29 Mizanur Rahman , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

Recently, Vision Language Models (VLMs) have increasingly emphasized document visual grounding to achieve better human-computer interaction, accessibility, and detailed understanding. However, its application to visualizations such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Alexander Vogel , Omar Moured , Yufan Chen , Jiaming Zhang , Rainer Stiefelhagen

Scientific Literature charts often contain complex visual elements, including multi-plot figures, flowcharts, structural diagrams and etc. Evaluating multimodal models using these authentic and intricate charts provides a more accurate…

Computation and Language · Computer Science 2024-12-18 Lingdong Shen , Qigqi , Kun Ding , Gaofeng Meng , Shiming Xiang

Chart question answering (CQA) has become a critical multimodal task for evaluating the reasoning capabilities of vision-language models. While early approaches have shown promising performance by focusing on visual features or leveraging…

Computation and Language · Computer Science 2025-05-30 Jingxuan Wei , Nan Xu , Junnan Zhu , Yanni Hao , Gaowei Wu , Bihui Yu , Lei Wang

Chart descriptions are essential for accessibility, cross-modal retrieval, and assisting readers in extracting insights from complex visualizations. As multimodal large language models (MLLMs) are increasingly adopted for automated chart…

Computation and Language · Computer Science 2026-05-25 Fen Wang , Zekai Shao , Qiman Kang , Chunran Hu , Zhixuan Zhang , Lexu Xie , Chao Liu , Siming Chen

Chart comprehension presents significant challenges for machine learning models due to the diverse and intricate shapes of charts. Existing multimodal methods often overlook these visual features or fail to integrate them effectively for…

Computation and Language · Computer Science 2024-08-01 Hanwen Zheng , Sijia Wang , Chris Thomas , Lifu Huang

Chart visualizations, while essential for data interpretation and communication, are predominantly accessible only as images in PDFs, lacking source data tables and stylistic information. To enable effective editing of charts in PDFs or…

Information Retrieval · Computer Science 2025-01-22 Kanika Goswami , Puneet Mathur , Ryan Rossi , Franck Dernoncourt

Recent advances in multimodal large language models (MLLMs) highlight the need for benchmarks that rigorously evaluate structured chart comprehension. Chart grounding refers to the bidirectional alignment between a chart's visual appearance…

Artificial Intelligence · Computer Science 2026-02-02 Xinhang Li , Jingbo Zhou , Pengfei Luo , Yixiong Xiao , Tong Xu

Given the ubiquity of charts as a data analysis, visualization, and decision-making tool across industries and sciences, there has been a growing interest in developing pre-trained foundation models as well as general purpose…

Artificial Intelligence · Computer Science 2024-11-05 Ahmed Masry , Megh Thakkar , Aayush Bajaj , Aaryaman Kartha , Enamul Hoque , Shafiq Joty

Pictorial charts are favored for their memorability and visual appeal, offering a more engaging alternative to basic charts. However, their creation can be complex and time-consuming due to the lack of native support in popular…

Human-Computer Interaction · Computer Science 2025-01-14 Siyu Yan , Tiancheng Liu , Weikai Yang , Nan Tang , Yuyu Luo

Vision-Language Models (VLMs) have shown promise in generating plotting code from chart images, yet achieving structural fidelity remains challenging. Existing approaches largely rely on supervised fine-tuning, encouraging surface-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Minggui He , Mingchen Dai , Jian Zhang , Yilun Liu , Shimin Tao , Pufan Zeng , Osamu Yoshie , Yuya Ieiri

Chart understanding tasks such as ChartQA and Chart-to-Text involve automatically extracting and interpreting key information from charts, enabling users to query or convert visual data into structured formats. State-of-the-art approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xudong Yang , Yifan Wu , Yizhang Zhu , Nan Tang , Yuyu Luo

Recent image editing models have achieved remarkable progress in instruction following, multimodal understanding, and complex visual editing. However, existing benchmarks often fail to faithfully reflect human judgment, especially for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Xuehai Bai , Yang Shi , Yi-Fan Zhang , Xuanyu Zhu , Yuran Wang , Yifan Dai , Xinyu Liu , Yiyan Ji , Xiaoling Gu , Yuanxing Zhang

Instruction-guided image editing has achieved remarkable progress, yet current models still face challenges with complex instructions and often require multiple samples to produce a desired result. Reinforcement Learning (RL) offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Luo , Jiahao Wang , Chenyuan Wu , Shitao Xiao , Xiyan Jiang , Defu Lian , Jiajun Zhang , Dong Liu , Zheng liu

We introduce TableVista, a comprehensive benchmark for evaluating foundation models in multimodal table reasoning under visual and structural complexity. TableVista consists of 3,000 high-quality table reasoning problems, where each…

Computation and Language · Computer Science 2026-05-08 Zheyuan Yang , Liqiang Shang , Junjie Chen , Xun Yang , Chenglong Xu , Bo Yuan , Chenyuan Jiao , Yaoru Sun , Yilun Zhao

Recent advances in image editing have enabled models to handle complex instructions with impressive realism. However, existing evaluation frameworks lag behind: current benchmarks suffer from narrow task coverage, while standard metrics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhangqi Jiang , Zheng Sun , Xianfang Zeng , Yufeng Yang , Xuanyang Zhang , Yongliang Wu , Wei Cheng , Gang Yu , Xu Yang , Bihan Wen

Data visualizations are central to scientific communication, journalism, and everyday decision-making, yet they are frequently prone to errors that can distort interpretation or mislead audiences. Rule-based visualization linters can flag…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Valentin Bonas , Martin Sinnona , Viviana Siless , Emmanuel Iarussi

Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains. However, their ability to replicate complex, multi-panel visualizations from real-world data remains largely unassessed. To…

The rapid development of diffusion models has significantly advanced AI-generated content (AIGC), particularly in Text-to-Image (T2I) and Text-to-Video (T2V) generation. Text-based video editing, leveraging these generative capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yupeng Chen , Penglin Chen , Xiaoyu Zhang , Yixian Huang , Qian Xie