English
Related papers

Related papers: ChartEditor: A Reinforcement Learning Framework fo…

200 papers

Data visualization serves as a critical means for presenting data and mining its valuable insights. The task of chart summarization, through natural language processing techniques, facilitates in-depth data analysis of charts. However,…

Computation and Language · Computer Science 2024-04-26 Mengsha Liu , Daoyuan Chen , Yaliang Li , Guian Fang , Ying Shen

Code editing encompasses a variety of pragmatic tasks that developers deal with daily. Despite its relevance and practical usefulness, automatic code editing remains an underexplored area in the evolution of deep learning models, partly due…

Computation and Language · Computer Science 2024-02-29 Kaixin Li , Qisheng Hu , Xu Zhao , Hui Chen , Yuxi Xie , Tiedong Liu , Qizhe Xie , Junxian He

Large multimodal language models (MLLMs) have revolutionized natural language processing and visual understanding, but often contain outdated or inaccurate information. Current multimodal knowledge editing evaluations are limited in scope…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Yaohui Ma , Xiaopeng Hong , Shizhou Zhang , Huiyun Li , Zhilin Zhu , Wei Luo , Zhiheng Ma

Code generation models have achieved impressive performance. However, they tend to be brittle as slight edits to a prompt could lead to very different generations; these robustness properties, critical for user experience when deployed in…

Real-world multimodal agents solve multi-step workflows grounded in visual evidence. For example, an agent can troubleshoot a device by linking a wiring photo to a schematic and validating the fix with online documentation, or plan a trip…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhaochen Su , Jincheng Gao , Hangyu Guo , Zhenhua Liu , Lueyang Zhang , Xinyu Geng , Shijue Huang , Peng Xia , Guanyu Jiang , Cheng Wang , Yue Zhang , Yi R. Fung , Junxian He

Visualizations play a crucial part in effective communication of concepts and information. Recent advances in reasoning and retrieval augmented generation have enabled Large Language Models (LLMs) to perform deep research and generate…

Computation and Language · Computer Science 2025-12-16 Zhaorui Yang , Bo Pan , Han Wang , Yiyao Wang , Xingyu Liu , Luoxuan Weng , Yingchaojie Feng , Haozhe Feng , Minfeng Zhu , Bo Zhang , Wei Chen

Although Multimodal Large Language Models (MLLMs) have demonstrated increasingly impressive performance in chart understanding, most of them exhibit alarming hallucinations and significant performance degradation when handling non-annotated…

Computation and Language · Computer Science 2025-12-16 Xiao Zhang , Dongyuan Li , Liuyu Xiang , Yao Zhang , Cheng Zhong , Zhaofeng He

Chart summarization is a crucial task for blind and visually impaired individuals as it is their primary means of accessing and interpreting graphical data. Crafting high-quality descriptions is challenging because it requires precise…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Omar Moured , Jiaming Zhang , M. Saquib Sarfraz , Rainer Stiefelhagen

Large language models can translate natural-language chart descriptions into runnable code, yet approximately 15\% of the generated scripts still fail to execute, even after supervised fine-tuning and reinforcement learning. We investigate…

Computation and Language · Computer Science 2025-06-09 James Ford , Anthony Rios

We introduce VisTA, a new reinforcement learning framework that empowers visual agents to dynamically explore, select, and combine tools from a diverse library based on empirical performance. Existing methods for tool-augmented reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zeyi Huang , Yuyang Ji , Anirudh Sundara Rajan , Zefan Cai , Wen Xiao , Haohan Wang , Junjie Hu , Yong Jae Lee

Vision-Language Models (VLMs) have demonstrated remarkable progress in chart understanding, largely driven by supervised fine-tuning (SFT) on increasingly large synthetic datasets. However, scaling SFT data alone is inefficient and…

Computation and Language · Computer Science 2026-05-12 Jianzhu Bao , Haozhen Zhang , Kuicai Dong , Bozhi Wu , Sarthak Ketanbhai Modi , Zi Pong Lim , Yon Shin Teo , Wenya Wang

Chart-to-code generation is a critical task in automated data visualization, translating complex chart structures into executable programs. While recent Multi-modal Large Language Models (MLLMs) improve chart representation, existing…

Software Engineering · Computer Science 2025-12-01 Yifei Wang , Jacky Keung , Zhenyu Mao , Jingyu Zhang , Yuchen Cao

Existing image editing models struggle to meet real-world demands. Despite excelling in academic benchmarks, they have yet to be widely adopted for real user needs. Datasets that power these models use artificial edits, lacking the scale…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Peter Sushko , Ayana Bharadwaj , Zhi Yang Lim , Vasily Ilin , Ben Caffee , Dongping Chen , Mohammadreza Salehi , Cheng-Yu Hsieh , Ranjay Krishna

With the growing reliance on automated code completion tools in software development, the need for comprehensive evaluation benchmarks has become critical. Existing benchmarks focus more on code completion in function and class level by…

Software Engineering · Computer Science 2025-11-03 Qinyun Wu , Chao Peng , Pengfei Gao , Ruida Hu , Haoyu Gan , Bo Jiang , Jinhe Tang , Zhiwen Deng , Zhanming Guan , Cuiyun Gao , Xia Liu , Ping Yang

Data augmentation has been demonstrated as an effective strategy for improving model generalization and data efficiency. However, due to the discrete nature of natural language, designing label-preserving transformations for text data tends…

Computation and Language · Computer Science 2020-10-20 Yanru Qu , Dinghan Shen , Yelong Shen , Sandra Sajeev , Jiawei Han , Weizhu Chen

While reinforcement learning (RL) has proven highly effective for general reasoning in vision-language models, its application to tasks requiring deep understanding of information-rich images and structured output generation remains…

Artificial Intelligence · Computer Science 2026-03-17 Lei Chen , Xuanle Zhao , Zhixiong Zeng , Jing Huang , Liming Zheng , Yufeng Zhong , Lin Ma

Chart-to-code generation converts a chart image into an executable plotting script, enabling faithful reproduction and editable visualizations. Existing methods are largely Python-centric, limiting practical use and overlooking a critical…

Computation and Language · Computer Science 2026-04-28 Zhihan Zhang , Lizi Liao

Information visualizations such as bar charts and line charts are very popular for exploring data and communicating insights. Interpreting and making sense of such visualizations can be challenging for some people, such as those who are…

Computation and Language · Computer Science 2020-12-01 Jason Obeid , Enamul Hoque

Instruction-guided video editing has emerged as a rapidly advancing research direction, offering new opportunities for intuitive content transformation while also posing significant challenges for systematic evaluation. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yinan Chen , Jiangning Zhang , Teng Hu , Yuxiang Zeng , Zhucun Xue , Qingdong He , Chengjie Wang , Yong Liu , Xiaobin Hu , Shuicheng Yan

The evaluation of visual editing models remains fragmented across methods and modalities. Existing benchmarks are often tailored to specific paradigms, making fair cross-paradigm comparisons difficult, while video editing lacks reliable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Lifan Jiang , Tianrun Wu , Yuhang Pei , Chenyang Wang , Boxi Wu , Deng Cai