English
Related papers

Related papers: TTRV: Test-Time Reinforcement Learning for Vision …

200 papers

Video understanding is inherently intention-driven-humans naturally focus on relevant frames based on their goals. Recent advancements in multimodal large language models (MLLMs) have enabled flexible query-driven reasoning; however,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Ziqiang Xu , Qi Dai , Tian Xie , Yifan Yang , Kai Qiu , DongDong Chen , Zuxuan Wu , Chong Luo

Recent advances demonstrate that reinforcement learning with verifiable rewards (RLVR) significantly enhances the reasoning capabilities of large language models (LLMs). However, standard RLVR faces challenges with reward sparsity, where…

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Vision-Language Models (VLMs) frequently suffer from visual perception errors and hallucinations that compromise answer accuracy in complex reasoning tasks. Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yin Zhang , Jiaxuan Zhao , Zonghan Wu , Zengxiang Li , Junfeng Fang , Kun Wang , Qingsong Wen , Yilei Shao

Recent work on reinforcement learning with verifiable rewards (RLVR) has shown that large language models (LLMs) can be substantially improved using outcome-level verification signals, such as unit tests for code or exact-match checks for…

Computation and Language · Computer Science 2026-01-27 Massimiliano Pronesti , Anya Belz , Yufang Hou

Recent advancements in reinforcement learning with verifiable rewards (RLVR) have significantly improved the complex reasoning ability of vision-language models (VLMs). However, its outcome-level supervision is too coarse to diagnose and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yingqian Min , Kun Zhou , Yifan Li , Yuhuan Wu , Han Peng , Yifan Du , Wayne Xin Zhao , Min Yang , Ji-Rong Wen

Enhancing the temporal understanding of Multimodal Large Language Models (MLLMs) is essential for advancing long-form video analysis, enabling tasks such as temporal localization, action detection, and time-sensitive question answering.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tao Wu , Li Yang , Gen Zhan , Yabin Zhang , Yiting Liao , Junlin Li , Deliang Fu , Li Zhang , Limin Wang

Model-free reinforcement learning (RL) is a powerful approach for learning control policies directly from high-dimensional state and observation. However, it tends to be data-inefficient, which is especially costly in robotic learning…

Robotics · Computer Science 2020-10-14 Xubo Lyu , Mo Chen

Vision-language pre-training (VLP) methods are blossoming recently, and its crucial goal is to jointly learn visual and textual features via a transformer-based architecture, demonstrating promising improvements on a variety of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Weihan Wang , Zhen Yang , Bin Xu , Juanzi Li , Yankui Sun

This paper investigates Reinforcement Learning (RL) approaches to enhance the reasoning capabilities of Large Language Model (LLM) agents in long-horizon, multi-turn scenarios. Although RL algorithms such as Group Relative Policy…

Reinforcement learning with verifiable rewards (RLVR) has recently advanced the reasoning capabilities of large language models (LLMs). While prior work has emphasized algorithmic design, data curation, and reward shaping, we investigate…

Machine Learning · Computer Science 2025-07-10 Xinjie Chen , Minpeng Liao , Guoxin Chen , Chengxi Li , Biao Fu , Kai Fan , Xinggao Liu

Reinforcement learning from verifiable rewards (RLVR), especially with Group Relative Policy Optimization (GRPO), has shown strong potential for improving the reasoning capabilities of large vision-language models (LVLMs). However, in…

Artificial Intelligence · Computer Science 2026-05-11 Bingqing Jiang , Difan Zou

Recently, reinforcement learning with verifiable rewards (RLVR) has been widely used for enhancing the reasoning abilities of large language models (LLMs). A core challenge in RLVR involves managing the exchange between entropy and…

Computation and Language · Computer Science 2025-08-05 Jia Deng , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Ji-Rong Wen

In reinforcement learning (RL), value-based algorithms learn to associate each observation with the states and rewards that are likely to be reached from it. We observe that many self-supervised image pre-training methods bear similarity to…

Machine Learning · Computer Science 2025-06-16 Dibya Ghosh , Sergey Levine

Learning to adapt pretrained language models to unlabeled, out-of-distribution data is a critical challenge, as models often falter on structurally novel reasoning tasks even while excelling within their training distribution. We introduce…

Computation and Language · Computer Science 2025-05-29 Mohammad Mahdi Moradi , Hossam Amer , Sudhir Mudur , Weiwei Zhang , Yang Liu , Walid Ahmed

Reinforcement Learning with Verifiable Rewards (RLVR) is a powerful framework for improving the reasoning abilities of Large Language Models (LLMs). However, current methods such as GRPO rely only on problems where the model responses to…

Computation and Language · Computer Science 2026-02-10 Thanh-Long V. Le , Myeongho Jeon , Kim Vu , Viet Lai , Eunho Yang

Large language models (LLMs) demonstrate impressive performance but lack the flexibility to adapt to human preferences quickly without retraining. In this work, we introduce Test-time Preference Optimization (TPO), a framework that aligns…

Computation and Language · Computer Science 2025-01-23 Yafu Li , Xuyang Hu , Xiaoye Qu , Linjie Li , Yu Cheng

Reinforcement Learning with Verifiable Rewards has recently advanced the capabilities of Large Language Models in complex reasoning tasks by providing explicit rule-based supervision. Among RLVR methods, GRPO and its variants have achieved…

Machine Learning · Computer Science 2026-03-11 Zepeng Zhai , Meilin Chen , Jiaxuan Zhao , Junlang Qian , Lei Shen , Yuan Lu

Despite significant progress, Vision-Language Models (VLMs) still struggle with complex visual reasoning, where multi-step dependencies cause early errors to cascade through the reasoning chain. Existing post-training paradigms are limited:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yanbei Jiang , Chao Lei , Yihao Ding , Krista Ehinger , Jey Han Lau

Vision--language models (VLMs) are increasingly aligned via Group Relative Policy Optimization (GRPO)-style training. However, relying solely on terminal outcome rewards yields sparse credit assignment in multi-step reasoning, weakening the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Feiding , Yongkang Zhang , Yuhao Liao , Zijian Zeng , Chunzheng Zhu , Yaozong Zheng , Yafei Liu , Yeling Peng , Youwei Wang , Sibo Wang , Huiming Yang , Linglin Liao , Shunzhi Yang
‹ Prev 1 4 5 6 7 8 10 Next ›