English
Related papers

Related papers: VideoChat-R1.5: Visual Test-Time Scaling to Reinfo…

200 papers

Long-context reasoning has significantly empowered large language models (LLMs) to tackle complex tasks, yet it introduces severe efficiency bottlenecks due to the computational complexity. Existing efficient approaches often rely on…

Computation and Language · Computer Science 2026-02-03 Yibo Wang , Yongcheng Jing , Shunyu Liu , Hao Guan , Rong-cheng Tu , Chengyu Wang , Jun Huang , Dacheng Tao

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Recent large vision-language models (LVLMs) can generate vision-text multimodal chain-of-thought (MCoT) traces after reinforcement fine-tuning (RFT). However, we observe that the visual information incorporated in MCoT is often inaccurate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zujing Liu , Junwen Pan , Qi She , Yuan Gao , Guisong Xia

Post-training with explicit reasoning traces is common to improve the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, acquiring high-quality reasoning traces is often costly and time-consuming. Hence, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qihuang Zhong , Liang Ding , Wenjie Xuan , Juhua Liu , Bo Du , Dacheng Tao

Although Multimodal Large Language Models (MLLMs) have demonstrated increasingly impressive performance in chart understanding, most of them exhibit alarming hallucinations and significant performance degradation when handling non-annotated…

Computation and Language · Computer Science 2025-12-16 Xiao Zhang , Dongyuan Li , Liuyu Xiang , Yao Zhang , Cheng Zhong , Zhaofeng He

Large multimodal models (LMMs) have shown great potential for video reasoning with textual Chain-of-Thought. However, they remain vulnerable to hallucinations, especially when processing long-form videos where evidence is sparse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zuhao Yang , Sudong Wang , Kaichen Zhang , Keming Wu , Sicong Leng , Yifan Zhang , Bo Li , Chengwei Qin , Shijian Lu , Xingxuan Li , Lidong Bing

Reinforcement fine-tuning (RFT), a two-stage framework consisting of supervised fine-tuning (SFT) and reinforcement learning (RL) has shown promising results on improving reasoning ability of large language models (LLMs). Yet extending RFT…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yifan Jiang , Yueying Wang , Rui Zhao , Toufiq Parag , Zhimin Chen , Zhenyu Liao , Jayakrishnan Unnikrishnan

Reasoning in vision-language models (VLMs) has recently attracted significant attention due to its broad applicability across diverse downstream tasks. However, it remains unclear whether the superior performance of VLMs stems from genuine…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Yige Xu , Yongjie Wang , Zizhuo Wu , Kaisong Song , Jun Lin , Zhiqi Shen

As multimodal large language models (MLLMs) frequently exhibit errors in complex video reasoning scenarios, correcting these errors is critical for uncovering their weaknesses and improving performance. However, existing benchmarks lack…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xusen Hei , Jiali Chen , Jinyu Yang , Mengchen Zhao , Yi Cai

Spatial reasoning is a core aspect of human intelligence that allows perception, inference and planning in 3D environments. However, current vision-language models (VLMs) struggle to maintain geometric coherence and cross-view consistency…

Artificial Intelligence · Computer Science 2025-12-03 Qiyao Xue , Weichen Liu , Shiqi Wang , Haoming Wang , Yuyang Wu , Wei Gao

Test-time Scaling (TTS) has been demonstrated to significantly enhance the reasoning capabilities of Large Language Models (LLMs) during the inference phase without altering model parameters. However, existing TTS methods are largely…

Computation and Language · Computer Science 2025-09-30 Guibin Zhang , Fanci Meng , Guancheng Wan , Zherui Li , Kun Wang , Zhenfei Yin , Lei Bai , Shuicheng Yan

Recent advances in image reasoning methods, particularly "Thinking with Images", have demonstrated remarkable success in Multimodal Large Language Models (MLLMs); however, this dynamic reasoning paradigm has not yet been extended to video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shijian Wang , Jiarui Jin , Xingjian Wang , Linxin Song , Runhao Fu , Hecheng Wang , Zongyuan Ge , Yuan Lu , Xuelian Cheng

Visual storytelling is an emerging field that combines images and narratives to create engaging and contextually rich stories. Despite its potential, generating coherent and emotionally resonant visual stories remains challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiaochuan Lin , Xiangyong Chen

Diffusion Multi-modal Large Language Models (dMLLMs) have recently emerged as a novel architecture unifying image generation and understanding. However, developing effective and efficient Test-Time Scaling (TTS) methods to unlock their full…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yi Xin , Siqi Luo , Tianxiang Xu , Qi Qin , Haoxing Chen , Kaiwen Zhu , Zhiwei Zhang , Yangfan He , Rongchao Zhang , Jinbin Bai , Shuo Cao , Bin Fu , Junjun He , Yihao Liu , Yuewen Cao , Xiaohong Liu

Vision-language models (VLMs) have shown strong performance on static visual understanding, yet they still struggle with dynamic spatial reasoning that requires imagining how scenes evolve under egocentric motion. Recent efforts address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wanyue Zhang , Wenxiang Wu , Wang Xu , Jiaxin Luo , Helu Zhi , Yibin Huang , Shuo Ren , Zitao Liu , Jiajun Zhang

Vision Large Language Models (VLLMs) exhibit promising potential for multi-modal understanding, yet their application to video-based emotion recognition remains limited by insufficient spatial and contextual awareness. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Zhifeng Wang , Qixuan Zhang , Peter Zhang , Wenjia Niu , Kaihao Zhang , Ramesh Sankaranarayana , Sabrina Caldwell , Tom Gedeon

Video Large Language Models (Video LLMs) have shown promising capabilities in video comprehension, yet they struggle with tracking temporal changes and reasoning about temporal relationships. While previous research attributed this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Lei Li , Yuanxin Liu , Linli Yao , Peiyuan Zhang , Chenxin An , Lean Wang , Xu Sun , Lingpeng Kong , Qi Liu

Visual-Interleaved Chain-of-Thought (VI-CoT) enables Multi-modal Large Language Models (MLLMs) to continually update their understanding and decision space based on step-wise intermediate visual states (IVS), much like a human would, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xuecheng Wu , Jiaxing Liu , Danlei Huang , Yifan Wang , Yunyun Shi , Kedi Chen , Junxiao Xue , Yang Liu , Chunlin Chen , Hairong Dong , Dingkang Yang