English
Related papers

Related papers: Reinforcement Learning Tuning for VideoLLMs: Rewar…

200 papers

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni

Time-series reasoning remains a significant challenge in multimodal large language models (MLLMs) due to the dynamic temporal patterns, ambiguous semantics, and lack of temporal priors. In this work, we introduce TimeMaster, a reinforcement…

Machine Learning · Computer Science 2025-06-17 Junru Zhang , Lang Feng , Xu Guo , Yuhan Wu , Yabo Dong , Duanqing Xu

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

Computation and Language · Computer Science 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Recently, reinforcement learning (RL)-based tuning has shifted the trajectory of Multimodal Large Language Models (MLLMs), particularly following the introduction of Group Relative Policy Optimization (GRPO). However, directly applying it…

Computation and Language · Computer Science 2025-05-21 Wenhui Zhu , Xuanzhao Dong , Xin Li , Peijie Qiu , Xiwen Chen , Abolfazl Razi , Aris Sotiras , Yi Su , Yalin Wang

Reinforcement Learning (RL) has proven to be an effective post-training strategy for enhancing reasoning in vision-language models (VLMs). Group Relative Policy Optimization (GRPO) is a recent prominent method that encourages models to…

Artificial Intelligence · Computer Science 2025-10-30 Jiaqi Wang , Kevin Qinghong Lin , James Cheng , Mike Zheng Shou

Recent works have demonstrated the effectiveness of reinforcement learning (RL)-based post-training for enhancing the reasoning capabilities of large language models (LLMs). In particular, Group Relative Policy Optimization (GRPO) has shown…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jinyoung Park , Jeehye Na , Jinyoung Kim , Hyunwoo J. Kim

Current Large Language Models (LLMs) often undergo supervised fine-tuning (SFT) to acquire tool use capabilities. However, SFT struggles to generalize to unfamiliar or complex tool use scenarios. Recent advancements in reinforcement…

Machine Learning · Computer Science 2025-04-22 Cheng Qian , Emre Can Acikgoz , Qi He , Hongru Wang , Xiusi Chen , Dilek Hakkani-Tür , Gokhan Tur , Heng Ji

Reasoning post-training improves Large Language Models (LLMs) on complex tasks such as mathematics and coding, but its benefits across diverse multimodal tasks remains uncertain. The trend of releasing parallel "Instruct" and "Thinking"…

Computation and Language · Computer Science 2026-05-12 Ruobing Zheng , Tianqi Li , Jianing Li , Qingpei Guo , Yi Yuan , Jingdong Chen

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

Reward models have been increasingly critical for improving the reasoning capability of LLMs. Existing research has shown that a well-trained reward model can substantially improve model performances at inference time via search. However,…

Machine Learning · Computer Science 2024-11-28 Jiaxuan Gao , Shusheng Xu , Wenjie Ye , Weilin Liu , Chuyi He , Wei Fu , Zhiyu Mei , Guangju Wang , Yi Wu

In recent years, training methods centered on Reinforcement Learning (RL) have markedly enhanced the reasoning and alignment performance of Large Language Models (LLMs), particularly in understanding human intents, following user…

Computation and Language · Computer Science 2025-09-23 Keliang Liu , Dingkang Yang , Ziyun Qian , Weijie Yin , Yuchi Wang , Hongsheng Li , Jun Liu , Peng Zhai , Yang Liu , Lihua Zhang

Temporal Video Grounding (TVG), the task of locating specific video segments based on language queries, is a core challenge in long-form video understanding. While recent Large Vision-Language Models (LVLMs) have shown early promise in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ye Wang , Ziheng Wang , Boshen Xu , Yang Du , Kejun Lin , Zihan Xiao , Zihao Yue , Jianzhong Ju , Liang Zhang , Dingyi Yang , Xiangnan Fang , Zewen He , Zhenbo Luo , Wenxuan Wang , Junqi Lin , Jian Luan , Qin Jin

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

Reinforcement Learning with Verifiable Rewards ( RLVR ) has emerged as a transformative paradigm for enhancing the reasoning capabilities of Large Language Models ( LLMs), yet its potential in 3D scene understanding remains under-explored.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xiongkun Linghu , Jiangyong Huang , Baoxiong Jia , Siyuan Huang

Multi-modal Large Language Models (MLLMs) show promise in video understanding. However, their reasoning often suffers from thinking drift and weak temporal comprehension, even when enhanced by Reinforcement Learning (RL) techniques like…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Peiyao Wang , Haotian Xu , Noranart Vesdapunt , Rui Hou , Jingyi Zhang , Haibin Ling , Oleksandr Obiednikov , Ning Zhou , Kah Kuen Fu

Reinforcement learning based post-training paradigms for Video Large Language Models (VideoLLMs) have achieved significant success by optimizing for visual-semantic tasks such as captioning or VideoQA. However, while these approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Xiaokun Sun , Zezhong Wu , Zewen Ding , Linli Xu

While reinforcement learning (RL) demonstrated remarkable success in enhancing the reasoning capabilities of language models, the training dynamics of RL in LLMs remain unclear. In this work, we provide an explanation of the RL training…

Machine Learning · Computer Science 2025-09-30 Xingwu Chen , Tianle Li , Difan Zou

Reinforcement Fine-Tuning (RFT) is proved to be greatly valuable for enhancing the reasoning ability of LLMs. Researchers have been starting to apply RFT to MLLMs, hoping it will also enhance the capabilities of visual understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xiaxu Chen , Wei Li , Chunxu Liu , Chi Xie , Xiaoyan Hu , Chengqian Ma , Feng Zhu , Rui Zhao

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding. However, seemingly plausible outputs often suffer from poor visual and temporal grounding: a model may fabricate object existence, assign…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yihao Quan , Zeru Shi , Jinman Zhao , Ruixiang Tang