中文
相关论文

相关论文: Do Reasoning Models Enhance Embedding Models?

200 篇论文

Although outcome-based reinforcement learning (RL) significantly advances the mathematical reasoning capabilities of Large Language Models (LLMs), its reliance on computationally expensive ground-truth annotations imposes a severe…

机器学习 · 计算机科学 2026-03-18 Zelin Zhang , Fei Cheng , Chenhui Chu

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in enhancing the reasoning capabilities of large language models (LLMs). However, existing RLVR methods often suffer from exploration inefficiency due to…

机器学习 · 计算机科学 2025-09-09 Ziheng Li , Zexu Sun , Jinman Zhao , Erxue Min , Yongcheng Zeng , Hui Wu , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Xu Chen , Zhi-Hong Deng

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

计算与语言 · 计算机科学 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Test-time scaling has been shown to substantially improve large language models' (LLMs) mathematical reasoning. However, for a large portion of mathematical corpora, especially theorem proving, RLVR's scalability is limited: intermediate…

计算与语言 · 计算机科学 2025-11-24 Zhen Wang , Zhifeng Gao , Guolin Ke

Reinforcement learning (RL) with verifiable rewards has become a standard post-training stage for boosting visual reasoning in vision-language models, yet it remains unclear what capabilities RL actually improves compared with supervised…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Xirui Li , Ming Li , Tianyi Zhou

Understanding how the human brain progresses from processing simple linguistic inputs to performing high-level reasoning is a fundamental challenge in neuroscience. While modern large language models (LLMs) are increasingly used to model…

计算与语言 · 计算机科学 2026-01-27 Linyang He , Tianjun Zhong , Richard Antonello , Gavin Mischler , Micah Goldblum , Nima Mesgarani

Reinforcement learning has emerged as a powerful paradigm for post-training large language models (LLMs) to improve reasoning. Approaches like Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning with Verifiable…

机器学习 · 计算机科学 2025-06-26 Yanzhi Zhang , Zhaoxi Zhang , Haoxiang Guan , Yilin Cheng , Yitong Duan , Chen Wang , Yue Wang , Shuxin Zheng , Jiyan He

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for post-training large language models (LLMs) on complex reasoning tasks. Yet, the conditions under which RLVR yields robust generalization remain…

机器学习 · 计算机科学 2026-03-05 Brian Lu , Hongyu Zhao , Shuo Sun , Hao Peng , Rui Ding , Hongyuan Mei

Reinforcement learning with verifiable rewards (RLVR) succeeds in reasoning tasks (e.g., math and code) by checking the final verifiable answer (i.e., a verifiable dot signal). However, extending this paradigm to open-ended generation is…

计算与语言 · 计算机科学 2026-01-27 Yuxin Jiang , Yufei Wang , Qiyuan Zhang , Xingshan Zeng , Liangyou Li , Jierun Chen , Chaofan Tao , Haoli Bai , Lifeng Shang

Vision-Language Models (VLMs) have rapidly advanced by leveraging powerful pre-trained Large Language Models (LLMs) as core reasoning backbones. As new and more capable LLMs emerge with improved reasoning, instruction-following, and…

人工智能 · 计算机科学 2026-04-14 Sameera Horawalavithana , Lauren Phillips , Ian Stewart , Sai Munikoti , Karl Pazdernik

Reinforcement learning from verifiable rewards (RLVR) stimulates the thinking processes of large language models (LLMs), substantially enhancing their reasoning abilities on verifiable tasks. It is often assumed that similar gains should…

计算与语言 · 计算机科学 2026-03-24 Kaiyuan Li , Jing-Cheng Pang , Yang Yu

Recent Reinforcement Learning (RL) advances for Large Language Models (LLMs) have improved reasoning tasks, yet their resource-constrained application to medical imaging remains underexplored. We introduce ChexReason, a vision-language…

Fine-tuning LLM-based text embedders via contrastive learning maps inputs and outputs into a new representational space, discarding the LLM's output semantics. We propose LLM2Vec-Gen, a self-supervised alternative that instead produces…

Reinforcement learning with verifiable rewards (RLVR) has demonstrated significant success in enhancing mathematical reasoning and coding performance of large language models (LLMs), especially when structured reference answers are…

计算与语言 · 计算机科学 2025-04-02 Yi Su , Dian Yu , Linfeng Song , Juntao Li , Haitao Mi , Zhaopeng Tu , Min Zhang , Dong Yu

In the unsupervised self-evolution of Multimodal Large Language Models, the quality of feedback signals during post-training is pivotal for stable and effective learning. However, existing self-evolution methods predominantly rely on…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Yunyao Yu , Zhengxian Wu , Zhuohong Chen , Hangrui Xu , Zirui Liao , Xiangwen Deng , Zhifang Liu , Senyuan Shi , Haoqian Wang

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Lu Qiu , Ying Shan , Xihui Liu

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central approach for improving the reasoning ability of large language models. Recent work studies RLVR through token entropy, arguing that high-entropy tokens drive…

机器学习 · 计算机科学 2025-12-02 Xinzhu Chen , Xuesheng Li , Zhongxiang Sun , Weijie Yu

Reinforcement Fine-Tuning (RFT) with verifiable rewards has advanced large language models but remains underexplored for Vision-Language (VL) models. The Vision-Language Reward Model (VL-RM) is key to aligning VL models by providing…

计算与语言 · 计算机科学 2025-06-18 Jipeng Zhang , Kehao Miao , Renjie Pi , Zhaowei Wang , Runtao Liu , Rui Pan , Tong Zhang

Reinforcement learning with verifiable rewards (RLVR) has recently advanced the reasoning capabilities of large language models (LLMs). While prior work has emphasized algorithmic design, data curation, and reward shaping, we investigate…

机器学习 · 计算机科学 2025-07-10 Xinjie Chen , Minpeng Liao , Guoxin Chen , Chengxi Li , Biao Fu , Kai Fan , Xinggao Liu