中文
相关论文

相关论文: Thinking with Deltas: Incentivizing Reinforcement …

200 篇论文

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for advancing complex reasoning in large language models, and recent work extends RLVR to multimodal large language models (MLLMs). This transfer,…

计算与语言 · 计算机科学 2026-05-22 Changyuan Tian , Zhicong Lu , Huaxing Liu , Xiang Wang , Shuai Li , Yu Chen , Wenqian Lv , Zichuan Lin , Juncheng Diao , Deheng Ye

Mathematical reasoning is a central challenge for large language models (LLMs), requiring not only correct answers but also faithful reasoning processes. Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising…

机器学习 · 计算机科学 2025-12-02 Md Tanvirul Alam , Nidhi Rastogi

Reinforcement Fine-Tuning (RFT) in Large Reasoning Models like OpenAI o1 learns from feedback on its answers, which is especially useful in applications when fine-tuning data is scarce. Recent open-source work like DeepSeek-R1 demonstrates…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Ziyu Liu , Zeyi Sun , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Reinforcement learning with verifiable rewards (RLVR) has shown promise in enhancing the reasoning performance of large language models (LLMs) by increasing test-time compute. However, even after extensive RLVR training, such models still…

人工智能 · 计算机科学 2026-03-10 Pinzheng Wang , Shuli Xu , Juntao Li , Yu Luo , Dong Li , Jianye Hao , Min Zhang

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

机器学习 · 计算机科学 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Reinforcement Learning with Verifiable Rewards (RLVR) enhances reasoning of Large Language Models (LLMs) but usually exhibits limited generation diversity due to the over-incentivization of positive rewards. Although methods like Negative…

机器学习 · 计算机科学 2026-05-11 Zihan Lin , Xiaohan Wang , Jie Cao , Jiajun Chai , Li Wang , Xiaodong Lu , Wei Lin , Ran He , Guojun Yin

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

机器学习 · 计算机科学 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Achieving robust perception-reasoning synergy is a central goal for advanced Vision-Language Models (VLMs). Recent advancements have pursued this goal via architectural designs or agentic workflows. However, these approaches are often…

人工智能 · 计算机科学 2026-05-15 Haozhe Wang , Qixin Xu , Changpeng Wang , Taofeng Xue , Chong Peng , Wenhu Chen , Fangzhen Lin

Reinforcement learning from verifiable rewards (RLVR) suffers from sparse outcome signals, creating severe exploration bottlenecks on complex reasoning tasks. Recent on-policy self-distillation methods attempt to address this by utilizing…

机器学习 · 计算机科学 2026-05-20 Yang Li , Erik Nijkamp , Semih Yavuz , Shafiq Joty

Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains limited for lightweight models essential for edge deployments. To address this issue,…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Jingze Wu , Quan Zhang , Hongfei Suo , Zeqiang Cai , Hongbo Chen

Current large vision-language models (LVLMs) typically employ a connector module to link visual features with text embeddings of large language models (LLMs) and use end-to-end training to achieve multi-modal understanding in a unified…

人工智能 · 计算机科学 2025-08-14 Zixian Guo , Ming Liu , Qilong Wang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inference typically provides; yet, retraining large models is often computationally expensive and data…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Reinforcement Learning with Verifiable Rewards (RLVR) is a central paradigm for turning large language models (LLMs) into reliable problem solvers, especially in logic-heavy domains. Despite its empirical success, it remains unclear whether…

机器学习 · 计算机科学 2026-01-27 Mingyuan Fan , Weiguang Han , Daixin Wang , Cen Chen , Zhiqiang Zhang , Jun Zhou

Diffusion large language models (dLLMs) offer a promising route to parallel and efficient text generation, but improving their reasoning ability requires effective post-training. Reinforcement learning with verifiable rewards (RLVR) is a…

计算与语言 · 计算机科学 2026-05-12 Zichao Yu , Shengze Xu , Bingqing Jiang , Wenyi Zhang , Difan Zou

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing Large Language Models (LLMs), exemplified by the success of OpenAI's o-series. In RLVR, rewards are derived from verifiable signals-such…

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for complex reasoning tasks with clear correctness signals such as math and coding. However, extending it to real-world reasoning tasks is challenging, as evaluation…

机器学习 · 计算机科学 2025-10-06 Anisha Gunjal , Anthony Wang , Elaine Lau , Vaskar Nath , Yunzhong He , Bing Liu , Sean Hendryx

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision Language Models…

人工智能 · 计算机科学 2025-10-08 Brandon Ong , Tej Deep Pala , Vernon Toh , William Chandra Tjhi , Soujanya Poria

Visual reasoning (VR), which is crucial in many fields for enabling human-like visual understanding, remains highly challenging. Recently, compositional visual reasoning approaches, which leverage the reasoning abilities of large language…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Fucai Ke , Vijay Kumar B G , Xingjian Leng , Zhixi Cai , Zaid Khan , Weiqing Wang , Pari Delir Haghighi , Hamid Rezatofighi , Manmohan Chandraker

Reinforcement Learning with Verifiable Rewards~(RLVR) has become a prominent paradigm to enhance the capabilities (i.e.\ long-context) of Large Language Models~(LLMs). However, it often relies on gold-standard answers or explicit evaluation…

计算与语言 · 计算机科学 2026-03-03 Yao Xiao , Lei Wang , Yue Deng , Guanzheng Chen , Ziqi Jin , Jung-jae Kim , Xiaoli Li , Roy Ka-wei Lee , Lidong Bing