English
Related papers

Related papers: Thinking with Images for Multimodal Reasoning: Fou…

200 papers

Multimodal Reasoning Models (MRMs) leveraging Chain-of-Thought (CoT) based thinking have revolutionized mathematical and logical problem-solving. However, we show that this paradigm struggles with generalized spatial intelligence. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sai Srinivas Kancheti , Aditya Sanjiv Kanade , Vineeth N. Balasubramanian , Tanuja Ganu

Chain-of-Thought reasoning has driven large language models to extend from thinking with text to thinking with images and videos. However, different modalities still have clear limitations: static images struggle to represent temporal…

Artificial Intelligence · Computer Science 2026-02-04 Andong Chen , Wenxin Zhu , Qiuyu Ding , Yuchen Song , Muyun Yang , Tiejun Zhao

Large Vision-Language Models (LVLMs) have recently demonstrated amazing success in multi-modal tasks, including advancements in Multi-modal Chain-of-Thought (MCoT) reasoning. Despite these successes, current benchmarks still follow a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zihui Cheng , Qiguang Chen , Jin Zhang , Hao Fei , Xiaocheng Feng , Wanxiang Che , Min Li , Libo Qin

Multimodal reasoning requires iterative coordination between language and vision, yet it remains unclear what constitutes a meaningful interleaved chain of thought. We posit that text and image thoughts should function as complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiawei Gu , Yunzhuo Hao , Huichen Will Wang , Linjie Li , Michael Qizhe Shieh , Yejin Choi , Ranjay Krishna , Yu Cheng

Vision-Language Models (VLM) exhibit strong reasoning capabilities, showing promise for end-to-end autonomous driving systems. Chain-of-Thought (CoT), as VLM's widely used reasoning strategy, is facing critical challenges. Existing textual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Lingjun Zhang , Yujian Yuan , Changjie Wu , Xinyuan Chang , Xin Cai , Shuang Zeng , Linzhe Shi , Sijin Wang , Hang Zhang , Mu Xu

Chain-of-Thought (CoT) prompting has achieved remarkable success in unlocking the reasoning capabilities of Large Language Models (LLMs). Although CoT prompting enhances reasoning, its verbosity imposes substantial computational overhead.…

Computation and Language · Computer Science 2026-04-21 Yifan Wang , Shiyu Li , Peiming Li , Xiaochen Yang , Yang Tang , Zheng Wei

We propose MIRA, a new benchmark designed to evaluate models in scenarios where generating intermediate visual images is essential for successful reasoning. Unlike traditional CoT methods that rely solely on text, tasks in MIRA require…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yiyang Zhou , Haoqin Tu , Zijun Wang , Zeyu Wang , Niklas Muennighoff , Fan Nie , Yejin Choi , James Zou , Chaorui Deng , Shen Yan , Haoqi Fan , Cihang Xie , Huaxiu Yao , Qinghao Ye

Recently, Interleaved-modal Chain-of-Thought (ICoT) reasoning has achieved remarkable success by leveraging both multimodal inputs and outputs, attracting increasing attention. While achieving promising performance, current ICoT methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xu Liu , Yongheng Zhang , Qiguang Chen , Yao Li , Sheng Wang , Libo Qin

Chain-of-Thought (CoT) prompting elicits large language models (LLMs) to produce a series of intermediate reasoning steps before arriving at the final answer. However, when transitioning to vision-language models (VLMs), their text-only…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jun Gao , Yongqi Li , Ziqiang Cao , Wenjie Li

A long-standing goal of AI systems is to perform complex multimodal reasoning like humans. Recently, large language models (LLMs) have made remarkable strides in such multi-step reasoning on the language modality solely by leveraging the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ge Zheng , Bin Yang , Jiajin Tang , Hong-Yu Zhou , Sibei Yang

Multi-modal reasoning requires the seamless integration of visual and linguistic cues, yet existing Chain-of-Thought methods suffer from two critical limitations in cross-modal scenarios: (1) over-reliance on single coarse-grained image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wenting Lu , Didi Zhu , Tao Shen , Donglin Zhu , Ayong Ye , Chao Wu

Chain-of-thought (CoT) reasoning enhances performance of large language models, but questions remain about whether these reasoning traces faithfully reflect the internal processes of the model. We present the first comprehensive study of…

Computation and Language · Computer Science 2025-11-04 Sriram Balasubramanian , Samyadeep Basu , Soheil Feizi

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

Computation and Language · Computer Science 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

Chain-of-Thought (CoT) has widely enhanced mathematical reasoning in Large Language Models (LLMs), but it still remains challenging for extending it to multimodal domains. Existing works either adopt a similar textual reasoning for image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xinyan Chen , Renrui Zhang , Dongzhi Jiang , Aojun Zhou , Shilin Yan , Weifeng Lin , Hongsheng Li

Reasoning lies at the heart of intelligence, shaping the ability to make decisions, draw conclusions, and generalize across domains. In artificial intelligence, as systems increasingly operate in open, uncertain, and multimodal…

Recently, inference-time scaling of chain-of-thought (CoT) has been demonstrated as a promising approach for addressing multi-modal reasoning tasks. While existing studies have predominantly centered on text-based thinking, the integration…

Computation and Language · Computer Science 2025-05-27 Yujie Lin , Ante Wang , Moye Chen , Jingyao Liu , Hao Liu , Jinsong Su , Xinyan Xiao

In the domain of text-to-image generative models, biases inherent in training datasets often propagate into generated content, posing significant ethical challenges, particularly in socially sensitive contexts. We introduce FairCoT, a novel…

Machine Learning · Computer Science 2025-09-16 Zahraa Al Sahili , Ioannis Patras , Matthew Purver

Chain of Thought (CoT) reasoning enhances logical performance by decomposing complex tasks, yet its multimodal extension faces a trade-off. The prevailing Thinking with Images paradigm achieves visual refocusing by explicitly cropping image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jizheng Ma , Xiaofei Zhou , Geyuan Zhang , Yanlong Song , Han Yan

Current image generation and editing methods primarily process textual prompts as direct inputs without reasoning about visual composition and explicit operations. We present Generation Chain-of-Thought (GoT), a novel paradigm that enables…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Rongyao Fang , Chengqi Duan , Kun Wang , Linjiang Huang , Hao Li , Shilin Yan , Hao Tian , Xingyu Zeng , Rui Zhao , Jifeng Dai , Xihui Liu , Hongsheng Li

Images usually convey richer detail than text, but often include redundant information, which potentially downgrades multimodal reasoning performance. When faced with lengthy or complex messages, humans tend to employ abstract thinking to…

Computation and Language · Computer Science 2025-12-16 Dairu Liu , Ziyue Wang , Minyuan Ruan , Fuwen Luo , Chi Chen , Peng Li , Yang Liu