English
Related papers

Related papers: See, Think, Learn: A Self-Taught Multimodal Reason…

200 papers

Recent breakthroughs in reasoning language models have significantly advanced text-based reasoning. On the other hand, Multi-modal Large Language Models (MLLMs) still lag behind, hindered by their outdated internal LLMs. Upgrading these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Xin Jin , Zhenguo Li , James T. Kwok , Yu Zhang

Reinforcement learning (RL) is becoming an important direction for post-training vision-language models (VLMs), but public training methodologies for unified multimodal RL remain much less mature, especially for heterogeneous reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yan Ma , Linge Du , Xuyang Shen , Shaoxiang Chen , Pengfei Li , Qibing Ren , Lizhuang Ma , Yuchao Dai , Pengfei Liu , Junjie Yan

State-of-the-art Vision-Language Models (VLMs) ground the vision and the language modality primarily via projecting the vision tokens from the encoder to language-like tokens, which are directly fed to the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Sivan Doveh , Shaked Perek , M. Jehanzeb Mirza , Wei Lin , Amit Alfassy , Assaf Arbelle , Shimon Ullman , Leonid Karlinsky

Despite impressive advancements in Visual-Language Models (VLMs) for multi-modal tasks, their reliance on RGB inputs limits precise spatial understanding. Existing methods for integrating spatial cues, such as point clouds or depth, either…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yang Liu , Ming Ma , Xiaomin Yu , Pengxiang Ding , Han Zhao , Mingyang Sun , Siteng Huang , Donglin Wang

Enhancing the multimodal reasoning capabilities of Multimodal Large Language Models (MLLMs) is a challenging task that has attracted increasing attention in the community. Recently, several studies have applied Reinforcement Learning with…

Machine Learning · Computer Science 2026-03-04 Tong Xiao , Xin Xu , Zhenya Huang , Hongyu Gao , Quan Liu , Qi Liu , Enhong Chen

Video Large Language Models (Video-LLMs) have recently shown strong performance in basic video understanding tasks, such as captioning and coarse-grained question answering, but struggle with compositional reasoning that requires multi-step…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haiyi Qiu , Minghe Gao , Long Qian , Kaihang Pan , Qifan Yu , Juncheng Li , Wenjie Wang , Siliang Tang , Yueting Zhuang , Tat-Seng Chua

Inference-time scaling has attracted much attention which significantly enhance the performance of Large Language Models (LLMs) in complex reasoning tasks by increasing the length of Chain-of-Thought. These longer intermediate reasoning…

Computation and Language · Computer Science 2025-05-21 Hongru Wang , Deng Cai , Wanjun Zhong , Shijue Huang , Jeff Z. Pan , Zeming Liu , Kam-Fai Wong

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

Computation and Language · Computer Science 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Online Video Large Language Models (VideoLLMs) play a critical role in supporting responsive, real-time interaction. Existing methods focus on streaming perception, lacking a synchronized logical reasoning stream. However, directly applying…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yiran Guan , Liang Yin , Dingkang Liang , Jianzhong Ju , Zhenbo Luo , Jian Luan , Yuliang Liu , Xiang Bai

Chain-of-thought (CoT) reasoning has emerged as an effective approach for activating latent capabilities in LLMs. Interestingly, we observe that both CoT reasoning and self-training share the core objective: iteratively leveraging…

Computation and Language · Computer Science 2025-05-27 Zongqian Wu , Baoduo Xu , Ruochen Cui , Mengmeng Zhan , Xiaofeng Zhu , Lei Feng

Structured, procedural reasoning is essential for Large Language Models (LLMs), especially in mathematics. While post-training methods have improved LLM performance, they still fall short in capturing deep procedural logic on complex tasks.…

Artificial Intelligence · Computer Science 2025-08-27 Zhichao Yang , Zhaoxin Fan , Gen Li , Yuanze Hu , Xinyu Wang , Ye Qiu , Xin Wang , Yifan Sun , Wenjun Wu

Most humans use visual imagination to understand and reason about language, but models such as BERT reason about language using knowledge acquired during text-only pretraining. In this work, we investigate whether vision-and-language…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Morris Alper , Michael Fiman , Hadar Averbuch-Elor

The cognitive faculty of visual reasoning necessitates the integration of multimodal perceptual processing and commonsense and external knowledge of the world. In recent years, a plethora of large vision-language models (LVLMs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Tien-Huy Nguyen , Quang-Khai Tran , Anh-Tuan Quang-Hoang

Logical reasoning with large language models (LLMs) has received growing attention. One mainstream approach translates natural language into formal logic and then applies symbolic solvers for deduction. While effective in many tasks, these…

Computation and Language · Computer Science 2026-02-02 Qingchuan Li , Jiatong Li , Zirui Liu , Mingyue Cheng , Yuting Zeng , Qi Liu , Tongxuan Liu

Recent advances in large language models (LLMs) have shown that Chain-of-Thought (CoT) reasoning can substantially improve performance on complex reasoning tasks. At the same time, In-Context Learning (ICL) has become an important mechanism…

Computation and Language · Computer Science 2026-05-19 Rui Chu

Multimodal LLMs (MLLMs) with a great ability of text and image understanding have received great attention. To achieve better reasoning with MLLMs, Chain-of-Thought (CoT) reasoning has been widely explored, which further promotes MLLMs'…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zefeng Wang , Zhen Han , Shuo Chen , Fan Xue , Zifeng Ding , Xun Xiao , Volker Tresp , Philip Torr , Jindong Gu

Visual reasoning, a cornerstone of human intelligence, encompasses complex perceptual and logical processes essential for solving diverse visual problems. While advances in computer vision have produced powerful models for various…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zetong Zhou , Dongping Chen , Zixian Ma , Zhihan Hu , Mingyang Fu , Sinan Wang , Yao Wan , Zhou Zhao , Ranjay Krishna

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

Self-evolving trainin--where models iteratively learn from their own outputs--has emerged as a key approach for complex reasoning tasks, addressing the scarcity of high-quality chain-of-thought data. However, its effectiveness in multimodal…

Computation and Language · Computer Science 2025-06-09 Wei Liu , Junlong Li , Xiwen Zhang , Fan Zhou , Yu Cheng , Junxian He

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongzhao Li , Zongyang Ma , Mingze Li , Songyou Li , Yu Rong , Tingyang Xu , Ziqi Zhang , Deli Zhao , Wenbing Huang