中文
相关论文

相关论文: PDCR: Perception-Decomposed Confidence Reward for …

200 篇论文

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision Language Models…

人工智能 · 计算机科学 2025-10-08 Brandon Ong , Tej Deep Pala , Vernon Toh , William Chandra Tjhi , Soujanya Poria

Visual Commonsense Reasoning (VCR) calls for explanatory reasoning behind question answering over visual scenes. To achieve this goal, a model is required to provide an acceptable rationale as the reason for the predicted answers. Progress…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Zhenyang Li , Yangyang Guo , Kejie Wang , Xiaolin Chen , Liqiang Nie , Mohan Kankanhalli

Text-based role-playing models can imitate character styles, yet they often fail to reflect a scene's atmosphere and evolving tension, both essential for immersive applications such as Virtual Reality (VR) games and interactive narratives.…

人工智能 · 计算机科学 2026-05-07 Miao Wang , Yuling Shi , Yijiang Li , Yeheng Chen , Xiaodong Gu , Bin Li , Bo Gao , Yaduan Ruan

Reinforcement learning with verifiable rewards (RLVR) has demonstrated significant success in enhancing mathematical reasoning and coding performance of large language models (LLMs), especially when structured reference answers are…

计算与语言 · 计算机科学 2025-04-02 Yi Su , Dian Yu , Linfeng Song , Juntao Li , Haitao Mi , Zhaopeng Tu , Min Zhang , Dong Yu

Recent advances in large language models (LLMs) have demonstrated that reinforcement learning with verifiable rewards (RLVR) can significantly enhance reasoning abilities by directly optimizing correctness, rather than relying solely on…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Minbin Huang , Runhui Huang , Chuanyang Zheng , Jingyao Li , Guoxuan Chen , Han Shi , Hong Cheng

Medical Vision-Language Models (Med-VLMs) have achieved success across various tasks, yet most existing methods overlook the modality misalignment issue that can lead to untrustworthy responses in clinical settings. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Songtao Jiang , Yan Zhang , Yeying Jin , Zhihang Tang , Yangyang Wu , Yang Feng , Jian Wu , Zuozhu Liu

Reinforcement learning (RL) has recently shown strong potential in improving the reasoning capabilities of large language models and is now being actively extended to vision-language models (VLMs). However, existing RL applications in VLMs…

机器学习 · 计算机科学 2025-04-07 Yan Ma , Steffi Chern , Xuyang Shen , Yiran Zhong , Pengfei Liu

Deep Reinforcement Learning (DRL) is a promising approach for teaching robots new behaviour. However, one of its main limitations is the need for carefully hand-coded reward signals by an expert. We argue that it is crucial to automate the…

机器人学 · 计算机科学 2021-08-09 Abdalkarim Mohtasib , Gerhard Neumann , Heriberto Cuayahuitl

We introduce Reasoning Core, a new scalable environment for Reinforcement Learning with Verifiable Rewards (RLVR), designed to advance foundational symbolic reasoning in Large Language Models (LLMs). Unlike existing benchmarks that focus on…

人工智能 · 计算机科学 2025-09-23 Valentin Lacombe , Valentin Quesnel , Damien Sileo

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for enhancing the reasoning capabilities of Large Language Models (LLMs). Despite its efficacy, RLVR faces a meta-learning bottleneck: it lacks…

机器学习 · 计算机科学 2026-02-12 Shiting Huang , Zecheng Li , Yu Zeng , Qingnan Ren , Zhen Fang , Qisheng Su , Kou Shi , Lin Chen , Zehui Chen , Feng Zhao

Reinforcement learning with verifiable rewards has significantly advanced reasoning in large language models (LLMs), but such signals remain coarse, offering only binary correctness feedback. This limitation often results in inefficiencies,…

机器学习 · 计算机科学 2026-04-20 Peixuan Han , Adit Krishnan , Gerald Friedland , Jiaxuan You , Chris Kong

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Image captioning is a fundamental task that bridges the visual and linguistic domains, playing a critical role in pre-training Large Vision-Language Models (LVLMs). Current state-of-the-art captioning models are typically trained with…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Long Xing , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Jianze Liang , Qidong Huang , Jiaqi Wang , Feng Wu , Dahua Lin

Vision-language process reward models (VL-PRMs) are increasingly used to score intermediate reasoning steps and rerank candidates under test-time scaling. However, they often function as black-box judges: a low step score may reflect a…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Junxin Wang , Dai Guan , Weijie Qiu , Zhihang Li , Yongbo Gai , Zhengyi Yang , Mengyu Zhou , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Existing robotic foundation policies are trained primarily via large-scale imitation learning. While such models demonstrate strong capabilities, they often struggle with long-horizon tasks due to distribution shift and error accumulation.…

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a core paradigm for enhancing the reasoning capabilities of Large Language Models (LLMs). To address the lack of verification signals at test time, prior studies…

计算与语言 · 计算机科学 2025-10-17 Wenkai Yang , Weijie Liu , Ruobing Xie , Yiju Guo , Lulu Wu , Saiyong Yang , Yankai Lin

Reinforcement Learning (RL) serves as a potent paradigm for enhancing reasoning capabilities in Large Language Models (LLMs), yet standard outcome-based approaches often suffer from reward sparsity and inefficient credit assignment. In this…

人工智能 · 计算机科学 2026-02-03 Xiangwei Wang , Wei Wang , Ken Chen , Nanduni Nimalsiri , Saman Halgamuge

While reinforcement learning has advanced the reasoning abilities of Large Language Models (LLMs), these gains are largely confined to English, creating a significant performance disparity across languages. To address this, we introduce…

计算与语言 · 计算机科学 2025-10-01 Fahim Faisal , Kaiqiang Song , Song Wang , Simin Ma , Shujian Liu , Haoyun Deng , Sathish Reddy Indurthi

Inspired by the success of DeepSeek-R1, we explore the potential of rule-based reinforcement learning (RL) in MLLM post-training for perception policy learning. While promising, our initial experiments reveal that incorporating a thinking…

计算机视觉与模式识别 · 计算机科学 2025-04-11 En Yu , Kangheng Lin , Liang Zhao , Jisheng Yin , Yana Wei , Yuang Peng , Haoran Wei , Jianjian Sun , Chunrui Han , Zheng Ge , Xiangyu Zhang , Daxin Jiang , Jingyu Wang , Wenbing Tao