English
Related papers

Related papers: CASHEW: Stabilizing Multimodal Reasoning via Itera…

200 papers

Generalization in Visual Question Answering (VQA) requires models to answer questions about images with contexts beyond the training distribution. Existing attempts primarily refine unimodal aspects, overlooking enhancements in multimodal…

Artificial Intelligence · Computer Science 2023-10-10 Trang Nguyen , Naoaki Okazaki

Chain-of-Thought (CoT) reasoning has become a foundation for eliciting multi-step reasoning in large language models, but recent studies show that its benefits do not scale monotonically with chain length: while longer CoT generally enables…

Artificial Intelligence · Computer Science 2026-05-19 Bin Lei , Caiwen Ding , Jiachen Yang , Ang Li , Xin Eric Wang

Reinforcement learning (RL) has shown promise in enhancing the general Chain-of-Thought (CoT) reasoning capabilities of multimodal large language models (MLLMs). However, when applied to improve general CoT reasoning, existing RL frameworks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Longtian Qiu , Shan Ning , Jiaxuan Sun , Xuming He

Video Large Language Models (Video-LLMs) have recently shown strong performance in basic video understanding tasks, such as captioning and coarse-grained question answering, but struggle with compositional reasoning that requires multi-step…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haiyi Qiu , Minghe Gao , Long Qian , Kaihang Pan , Qifan Yu , Juncheng Li , Wenjie Wang , Siliang Tang , Yueting Zhuang , Tat-Seng Chua

Multimodal large language models (MLLMs) have demonstrated impressive reasoning and instruction-following capabilities, yet their expanded modality space introduces new compositional safety risks that emerge from complex text-image…

Cryptography and Security · Computer Science 2025-11-18 Xuankun Rong , Wenke Huang , Tingfeng Wang , Daiguo Zhou , Bo Du , Mang Ye

Reasoning quality in large language models depends not only on producing correct answers but also on generating valid intermediate steps. We study this through multiple-choice question answering (MCQA), which provides a controlled setting…

Artificial Intelligence · Computer Science 2025-10-01 Raphael Schumann , Stefan Riezler

Vision-language reinforcement learning (RL) has primarily focused on narrow domains (e.g. geometry or chart reasoning). This leaves broader training scenarios and resources underexplored, limiting the exploration and learning of Vision…

Vision language models (VLMs) have achieved impressive performance across a variety of computer vision tasks. However, the multimodal reasoning capability has not been fully explored in existing models. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Xintong Zhang , Zhi Gao , Bofei Zhang , Pengxiang Li , Xiaowen Zhang , Yang Liu , Tao Yuan , Yuwei Wu , Yunde Jia , Song-Chun Zhu , Qing Li

Reinforcement learning (RL) has made significant advancements, achieving superhuman performance in various tasks. However, RL agents often operate under the assumption of environmental stationarity, which poses a great challenge to learning…

Machine Learning · Computer Science 2025-11-18 Guoqing Ma , Yuhan Zhang , Yuming Dai , Guangfu Hao , Yang Chen , Shan Yu

Multimodal document question answering requires retrieving dispersed evidence from visually rich long documents and performing reliable reasoning over heterogeneous information. Existing multimodal RAG systems remain limited by two…

Information Retrieval · Computer Science 2026-03-18 Jiashu Yang , Chi Zhang , Abudukelimu Wuerkaixi , Xuxin Cheng , Cao Liu , Ke Zeng , Xu Jia , Xunliang Cai

Cloze-style reading comprehension has been a popular task for measuring the progress of natural language understanding in recent years. In this paper, we design a novel multi-perspective framework, which can be seen as the joint training of…

Computation and Language · Computer Science 2018-08-21 Liang Wang , Sujian Li , Wei Zhao , Kewei Shen , Meng Sun , Ruoyu Jia , Jingming Liu

Test-time scaling improves large language models' (LLMs) performance by allocating more compute budget during inference. To achieve this, existing methods often require intricate modifications to prompting and sampling strategies. In this…

Computation and Language · Computer Science 2025-11-04 Junqi Jiang , Tom Bewley , Salim I. Amoukou , Francesco Leofante , Antonio Rago , Saumitra Mishra , Francesca Toni

Recent advances in large language models have significantly improved textual reasoning through the effective use of Chain-of-Thought (CoT) and reinforcement learning. However, extending these successes to vision-language tasks remains…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Minheng Ni , Zhengyuan Yang , Linjie Li , Chung-Ching Lin , Kevin Lin , Wangmeng Zuo , Lijuan Wang

Real-world audio-visual understanding requires chaining evidence that is sparse, temporally dispersed, and split across the visual and auditory streams, whereas existing benchmarks largely fail to evaluate this capability. They restrict…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hengyi Feng , Hao Liang , Mingrui Chen , Bohan Zeng , Meiyi Qiang , Zhengyang Zhao , Zimo Meng , Zeang Sheng , Wentao Zhang

Long-form video understanding remains fundamentally challenged by pervasive spatiotemporal redundancy and intricate narrative dependencies that span extended temporal horizons. While recent structured representations compress visual…

Artificial Intelligence · Computer Science 2026-04-24 Yuehan Zhu , Jingqi Zhao , Jiawen Zhao , Xudong Mao , Baoquan Zhao

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

The prosperity of Multimodal Large Language Models (MLLMs) has stimulated the demand for video reasoning segmentation, which aims to segment video objects based on human instructions. Previous studies rely on unidirectional and implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jingnan Luo , Mingqi Gao , Jun Liu , Bin-Bin Gao , Feng Zheng

Large language models (LLMs) have demonstrated strong reasoning capabilities, and as existing approaches for enhancing LLM reasoning continue to mature, increasing attention has shifted toward meta-reasoning as a promising direction for…

Artificial Intelligence · Computer Science 2026-04-21 Ziqing Zhuang , Linhai Zhang , Jiasheng Si , Deyu Zhou , Yulan He

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

Machine Learning · Computer Science 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

Machine Learning · Computer Science 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen