English
Related papers

Related papers: Visually-Guided Policy Optimization for Multimodal…

200 papers

Spatial reasoning remains a critical yet underdeveloped capability in existing vision-language models (VLMs), especially for Spatial Visual Question Answering (Spatial VQA) tasks that require understanding relative positions, distances, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peiyao Wang , Haibin Ling

Reinforcement learning with verifiable rewards (RLVR) has recently advanced the reasoning capabilities of large language models (LLMs). While prior work has emphasized algorithmic design, data curation, and reward shaping, we investigate…

Machine Learning · Computer Science 2025-07-10 Xinjie Chen , Minpeng Liao , Guoxin Chen , Chengxi Li , Biao Fu , Kai Fan , Xinggao Liu

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an indispensable paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard policy optimization methods, such as Group Relative Policy…

Machine Learning · Computer Science 2026-02-09 Pengyi Li , Elizaveta Goncharova , Andrey Kuznetsov , Ivan Oseledets

Reinforcement Learning from Human Feedback (RLHF) often suffers from noisy or imperfect reward supervision in real-world settings, which undermines policy stability and generalization. Such noise may cause models to lose attention on key…

Vision-Language Models (VLMs) show promise in medical image analysis, yet their capacity for structured reasoning in complex domains like dermatology is often limited by data scarcity and the high computational cost of advanced training…

Computation and Language · Computer Science 2025-10-03 Ismam Nur Swapnil , Aranya Saha , Tanvir Ahmed Khan , Mohammad Ariful Haque

Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and natural language goals. While recent vision-language models (VLMs) excel at static perception tasks, they struggle with the…

Artificial Intelligence · Computer Science 2025-07-15 Di Wu , Jiaxin Fan , Junzhe Zang , Guanbo Wang , Wei Yin , Wenhao Li , Bo Jin

Reinforcement learning with verifiable rewards (RLVR) has become a powerful paradigm for improving language models on reasoning-intensive tasks, but its effectiveness is often limited by exploration. For example, models often fail on hard…

Machine Learning · Computer Science 2026-05-26 Ruitao Liu , Qinghao Hu , Alex Hu , Yecheng Wu , Shang Yang , Luke J. Huang , Zhuoyang Zhang , Han Cai , Song Han

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Sitong Gong , Lu Zhang , Yunzhi Zhuge , Xu Jia , Pingping Zhang , Huchuan Lu

Large language models frequently exhibit suboptimal performance on low resource languages, primarily due to inefficient subword segmentation and systemic training data imbalances. In this paper, we propose Variable Entropy Policy…

Computation and Language · Computer Science 2026-03-20 Chonghan Liu , Yimin Du , Qi An , Xin He , Cunqi Zhai , Fei Tan , Weijia Lin , Xiaochun Gong , Yongchao Deng , Shousheng Jia , Xiangzheng Zhang

Inference time scaling drives extended reasoning to enhance the performance of Vision-Language Models (VLMs), thus forming powerful Vision-Language Reasoning Models (VLRMs). However, long reasoning dilutes visual tokens, causing visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xu Chu , Xinrong Chen , Guanyu Wang , Zhijie Tan , Kui Huang , Wenyu Lv , Tong Mo , Weiping Li

Long chain-of-thought (CoT) reasoning improves large vision--language models, but visual information often fades during generation, limiting long-horizon multimodal reasoning. Existing methods either re-inject vision at inference or train…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xuan Gong , Hanbo Huang , Hao Zheng , Yiran Zhang , Wenbin Dai , Weishu Zhao , Shiyu Liang

Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generation rather than verifiable reasoning. This limitation is especially pronounced in tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Tinghui Zhu , Sheng Zhang , James Y. Huang , Selena Song , Xiaofei Wen , Yuankai Li , Hoifung Poon , Muhao Chen

The VAPO framework has demonstrated significant empirical success in enhancing the efficiency and reliability of reinforcement learning for long chain-of-thought (CoT) reasoning tasks with large language models (LLMs). By systematically…

Machine Learning · Computer Science 2025-05-28 Jintian Shao , Yiming Cheng , Hongyi Huang , Beiwen Zhang , Zhiyu Wu , You Shan , Mingkai Zheng

Visual reinforcement learning (RL) suffers from poor sample efficiency due to high-dimensional observations in complex tasks. While existing works have shown that vision-language models (VLMs) can assist RL, they often focus on knowledge…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Canming Xia , Peixi Peng , Guang Tan , Zhan Su , Haoran Xu , Zhenxian Liu , Luntong Li

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for Large Language Model (LLM) reasoning, yet current methods face key challenges in resource allocation and policy optimization dynamics: (i) uniform rollout…

Machine Learning · Computer Science 2026-04-24 Yangyi Fang , Jiaye Lin , Xiaoliang Fu , Cong Qin , Haolin Shi , Chaowen Hu , Lu Pan , Ke Zeng , Xunliang Cai

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal benchmarks and two…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yizhuo Ding , Mingkang Chen , Zhibang Feng , Tong Xiao , Wanying Qu , Wenqi Shao , Yanwei Fu

Reinforcement Learning with Verifiable Rewards (RLVR) has become a promising paradigm for scaling reasoning capabilities of Large Language Models (LLMs). However, the sparsity of binary verifier rewards often leads to low efficiency and…

Machine Learning · Computer Science 2026-05-22 Shuo Yang , Jinda Lu , Kexin Huang , Chiyu Ma , Shaohang Wei , Yuyang Liu , Guoyin Wang , Jingren Zhou , Li Yuan

While chain-of-thought (CoT) reasoning has substantially improved multimodal large language models (MLLMs) on complex reasoning tasks, existing approaches largely rely on long textual reasoning trajectories and provide limited mechanisms…

Artificial Intelligence · Computer Science 2026-02-10 Siqu Ou , Tianrui Wan , Zhiyuan Zhao , Junyu Gao , Xuelong Li

Recent studies have extended Reinforcement Learning with Verifiable Rewards (RLVR) to autoregressive (AR) visual generation and achieved promising progress. However, existing methods typically apply uniform optimization across all image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Guohui Zhang , Hu Yu , Xiaoxiao Ma , JingHao Zhang , Yaning Pan , Mingde Yao , Jie Xiao , Linjiang Huang , Feng Zhao

Reinforcement learning has emerged as a dominant technique for fine-tuning the behavior of large language models, with policy optimization (PO) algorithms such as GRPO, DAPO, and Dr. GRPO emerging in rapid succession to advance…

Human-Computer Interaction · Computer Science 2026-05-13 Aeree Cho , Alexander D. Greenhalgh , Jonathan Bodea , Anthony Peng , Duen Horng , Chau