English
Related papers

Related papers: ChartM$^3$: A Multi-Stage Code-Driven Pipeline for…

200 papers

Recent progress in retrieval-augmented generation (RAG) has led to more accurate and interpretable multi-hop question answering (QA). Yet, challenges persist in integrating iterative reasoning steps with external knowledge retrieval. To…

Computation and Language · Computer Science 2025-10-06 Tengjun Ni , Xin Yuan , Shenghong Li , Kai Wu , Ren Ping Liu , Wei Ni , Wenjie Zhang

Chart-to-code generation demands strict visual precision and syntactic correctness from Vision-Language Models (VLMs). However, existing approaches are fundamentally constrained by data-centric limitations: despite the availability of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Xiangxi Zheng , Kuang He , Jiayi Hu , Ping Yu , Rui Yan , Yuan Yao , Peng Hou , Anxiang Zeng , Alex Jinpeng Wang

Large Language Models (LLMs) have demonstrated impressive performance in natural language processing tasks by leveraging chain of thought (CoT) that enables step-by-step thinking. Extending LLMs with multimodal capabilities is the recent…

Computation and Language · Computer Science 2024-01-24 Debjyoti Mondal , Suraj Modi , Subhadarshi Panda , Rituraj Singh , Godawari Sudhakar Rao

Chart question answering (ChartQA) tasks play a critical role in interpreting and extracting insights from visualization charts. While recent advancements in multimodal large language models (MLLMs) like GPT-4o have shown promise in…

Computation and Language · Computer Science 2024-11-07 Yifan Wu , Lutao Yan , Leixian Shen , Yunhai Wang , Nan Tang , Yuyu Luo

Large Reasoning Models (LRMs) have demonstrated strong performance by producing extended Chain-of-Thought (CoT) traces before answering. However, this paradigm often induces over-reasoning: redundant calculations and circular…

Artificial Intelligence · Computer Science 2026-03-10 Siyi Li , Jiajun Shi , Shiwen Ni , Ge Zhang , Shuaimin Li , Shijian Wang , Zhoufutu Wen , Yizhi Li , Hamid Alinejad-Rokny , Jiaheng Liu , Min Yang , Wenhao Huang

The mathematical capabilities of Multi-modal Large Language Models (MLLMs) remain under-explored with three areas to be improved: visual encoding of math diagrams, diagram-language alignment, and chain-of-thought (CoT) reasoning. This draws…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Renrui Zhang , Xinyu Wei , Dongzhi Jiang , Ziyu Guo , Shicheng Li , Yichi Zhang , Chengzhuo Tong , Jiaming Liu , Aojun Zhou , Bin Wei , Shanghang Zhang , Peng Gao , Chunyuan Li , Hongsheng Li

Music Information Retrieval (MIR) encompasses a broad range of computational techniques for analyzing and understanding musical content, with recent deep learning advances driving substantial improvements. Building upon these advances, this…

Sound · Computer Science 2025-09-24 Chih-Cheng Chang , Bo-Yu Chen , Lu-Rong Chen , Li Su

Real-world reasoning often requires combining information across modalities, connecting textual context with visual cues in a multi-hop process. Yet, most multimodal benchmarks fail to capture this ability: they typically rely on single…

Machine Learning · Computer Science 2026-04-03 Junyoung Sung , Seungwoo Lyu , Minjun Kim , Sumin An , Arsha Nagrani , Paul Hongsuck Seo

In this study, we address the growing issue of misleading charts, a prevalent problem that undermines the integrity of information dissemination. Misleading charts can distort the viewer's perception of data, leading to misinterpretations…

Human-Computer Interaction · Computer Science 2024-07-25 Leo Yu-Ho Lo , Huamin Qu

Current multimodal large language models (MLLMs), while effective in natural image understanding, struggle with visualization understanding due to their inability to decode the data-to-visual mapping and extract structured information. To…

Human-Computer Interaction · Computer Science 2025-07-03 Can Liu , Chunlin Da , Xiaoxiao Long , Yuxiao Yang , Yu Zhang , Yong Wang

Visual reasoning over structured data such as tables is a critical capability for modern vision-language models (VLMs), yet current benchmarks remain limited in scale, diversity, or reasoning depth, especially when it comes to rendered…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Boammani Aser Lompo , Marc Haraoui

With advancements in deep learning (DL) and computer vision techniques, the field of chart understanding is evolving rapidly. In particular, multimodal large language models (MLLMs) are proving to be efficient and accurate in understanding…

Artificial Intelligence · Computer Science 2026-01-21 Ahmad Mustapha , Charbel Toumieh , Mariette Awad

Although Multimodal Large Language Models have achieved remarkable progress, they still struggle with complex 3D spatial reasoning due to the reliance on 2D visual priors. Existing approaches typically mitigate this limitation either…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jiahua Chen , Qihong Tang , Weinong Wang , Qi Fan

Exploratory analysis of high-dimensional data relies on embedding the data into a low-dimensional space (typically 2D or 3D), based on which visualization plot is produced to uncover meaningful structures and to communicate geometric and…

Human-Computer Interaction · Computer Science 2026-04-23 Burak Susam , Tingting Mu

Document understanding is critical for applications from financial analysis to scientific discovery. Current approaches, whether OCR-based pipelines feeding Large Language Models (LLMs) or native Multimodal LLMs (MLLMs), face key…

Computation and Language · Computer Science 2026-04-21 Sensen Gao , Shanshan Zhao , Xu Jiang , Lunhao Duan , Yong Xien Chng , Qing-Guo Chen , Weihua Luo , Kaifu Zhang , Jia-Wang Bian , Mingming Gong

Flowcharts are indispensable tools in software design and business-process analysis, yet current vision-language models (VLMs) frequently misinterpret the directional arrows and graph topology that set these diagrams apart from natural…

Artificial Intelligence · Computer Science 2025-05-14 Takamitsu Omasa , Ryo Koshihara , Masumi Morishige

Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily…

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension,…

Artificial Intelligence · Computer Science 2026-04-06 Yunfei Bai , Amit Dhanda , Shekhar Jain

Large language models (LLMs) show strong reasoning via chain-of-thought (CoT) prompting, but the process is opaque, which makes verification, debugging, and control difficult in high-stakes settings. We present Vis-CoT, a human-in-the-loop…

Computation and Language · Computer Science 2025-12-30 Kaviraj Pather , Elena Hadjigeorgiou , Arben Krasniqi , Claire Schmit , Irina Rusu , Marc Pons , Kabir Khan

Chain-of-Thought (CoT) prompting has emerged as a powerful approach to enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing implementations, such as in-context learning and fine-tuning, remain costly and…

Computation and Language · Computer Science 2025-10-02 Li Li , Ziyi Wang , Yongliang Wu , Jianfei Cai , Xu Yang