English
Related papers

Related papers: CodePlot-CoT: Mathematical Visual Reasoning by Thi…

200 papers

Large Language Models (LLMs) have made notable progress in mathematical reasoning, yet often rely on single-paradigm reasoning, limiting their effectiveness across diverse tasks. We introduce Chain-of-Reasoning (CoR), a novel unified…

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

Existing research of video understanding still struggles to achieve in-depth comprehension and reasoning in complex videos, primarily due to the under-exploration of two key bottlenecks: fine-grained spatial-temporal perceptive…

Artificial Intelligence · Computer Science 2025-01-08 Hao Fei , Shengqiong Wu , Wei Ji , Hanwang Zhang , Meishan Zhang , Mong-Li Lee , Wynne Hsu

Large Language Models (LLMs) have demonstrated remarkable potential in code generation. The integration of Chain of Thought (CoT) reasoning can further boost their performance. However, current CoT methods often require manual writing or…

Software Engineering · Computer Science 2024-08-06 Guang Yang , Yu Zhou , Xiang Chen , Xiangyu Zhang , Terry Yue Zhuo , Taolue Chen

Multimodal large language models (MLLMs) have significantly advanced the integration of visual and textual understanding. However, their ability to generate code from multimodal inputs remains limited. In this work, we introduce VisCodex, a…

Computation and Language · Computer Science 2025-08-14 Lingjie Jiang , Shaohan Huang , Xun Wu , Yixia Li , Dongdong Zhang , Furu Wei

By extending the advantage of chain-of-thought (CoT) reasoning in human-like step-by-step processes to multimodal contexts, multimodal CoT (MCoT) reasoning has recently garnered significant research attention, especially in the integration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yaoting Wang , Shengqiong Wu , Yuecheng Zhang , Shuicheng Yan , Ziwei Liu , Jiebo Luo , Hao Fei

Chain-of-thought (CoT) traces have been shown to improve performance of large language models on a plethora of reasoning tasks, yet there is no consensus on the mechanism by which this boost is achieved. To shed more light on this, we…

Computation and Language · Computer Science 2026-01-21 Soumadeep Saha , Akshay Chaturvedi , Saptarshi Saha , Utpal Garain , Nicholas Asher

The rapid advancement of Large Vision Language Models (LVLMs) has demonstrated excellent abilities in various visual tasks. Building upon these developments, the thinking with images paradigm has emerged, enabling models to dynamically edit…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yujin Zhou , Pengcheng Wen , Jiale Chen , Boqin Yin , Han Zhu , Jiaming Ji , Juntao Dai , Chi-Min Chan , Sirui Han

Chain-of-thought reasoning has significantly improved the performance of Large Language Models (LLMs) across various domains. However, this reasoning process has been confined exclusively to textual space, limiting its effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Haozhe Wang , Alex Su , Weiming Ren , Fangzhen Lin , Wenhu Chen

Large language models have shown impressive results for multi-hop mathematical reasoning when the input question is only textual. Many mathematical reasoning problems, however, contain both text and image. With the ever-increasing adoption…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Mehran Kazemi , Hamidreza Alvari , Ankit Anand , Jialin Wu , Xi Chen , Radu Soricut

Vision Language Models (VLMs) have achieved remarkable progress in multimodal tasks, yet they often struggle with visual arithmetic, seemingly simple capabilities like object counting or length comparison, which are essential for relevant…

Artificial Intelligence · Computer Science 2025-05-27 Kung-Hsiang Huang , Can Qin , Haoyi Qiu , Philippe Laban , Shafiq Joty , Caiming Xiong , Chien-Sheng Wu

Video content comprehension is essential for various applications, ranging from video analysis to interactive systems. Despite advancements in large-scale vision-language models (VLMs), these models often struggle to capture the nuanced,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyi Zhang , Xiaoshuai Hao , Yingbo Tang , Lingfeng Zhang , Pengwei Wang , Zhongyuan Wang , Hongxuan Ma , Shanghang Zhang

Recent advances in large language models have significantly improved textual reasoning through the effective use of Chain-of-Thought (CoT) and reinforcement learning. However, extending these successes to vision-language tasks remains…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Minheng Ni , Zhengyuan Yang , Linjie Li , Chung-Ching Lin , Kevin Lin , Wangmeng Zuo , Lijuan Wang

Thinking-with-images paradigms have showcased remarkable visual reasoning capability by integrating visual information as dynamic elements into the Chain-of-Thought (CoT). However, optimizing interleaved multimodal CoT (iMCoT) through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Wenxi Yang , Yuzhong Zhao , Fang Wan , Qixiang Ye

Faithful reasoning in medical vision-language models (VLMs) requires not only accurate predictions but also transparent alignment between textual rationales and visual evidence. While Chain-of-Thought (CoT) prompting has shown promise in…

Humans construct internal world models and reason by manipulating the concepts within these models. Recent advances in AI, particularly chain-of-thought (CoT) reasoning, approximate such human cognitive abilities, where world models are…

Artificial Intelligence · Computer Science 2026-01-28 Jialong Wu , Xiaoying Zhang , Hongyi Yuan , Xiangcheng Zhang , Tianhao Huang , Changjing He , Chaoyi Deng , Renrui Zhang , Youbin Wu , Mingsheng Long

Large Language Models (LLMs) have demonstrated promising capabilities in solving mathematical reasoning tasks, leveraging Chain-of-Thought (CoT) data as a vital component in guiding answer generation. Current paradigms typically generate…

Computation and Language · Computer Science 2025-03-20 Honglin Lin , Zhuoshi Pan , Yu Li , Qizhi Pei , Xin Gao , Mengzhang Cai , Conghui He , Lijun Wu

Reasoning is a fundamental capability for solving complex multi-step problems, particularly in visual contexts where sequential step-wise understanding is essential. Existing approaches lack a comprehensive framework for evaluating visual…

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

We present S1-VL, a multimodal reasoning model for scientific domains that natively supports two complementary reasoning paradigms: Scientific Reasoning, which relies on structured chain-of-thought, and Thinking-with-Images, which enables…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Qingxiao Li , Lifeng Xu , QingLi Wang , Yudong Bai , Mingwei Ou , Shu Hu , Nan Xu