中文
相关论文

相关论文: Do Reasoning Models Enhance Embedding Models?

200 篇论文

The remarkable success of multimodal large language models (MLLMs) has driven advances in multimodal embeddings, yet existing models remain inherently discriminative, limiting their ability to benefit from reasoning-driven generation…

机器学习 · 计算机科学 2026-03-03 Zhibin Lan , Liqiang Niu , Fandong Meng , Jie Zhou , Jinsong Su

Multimodal Reward Models (MRMs) play a crucial role in enhancing the performance of Multimodal Large Language Models (MLLMs). While recent advancements have primarily focused on improving the model structure and training data of MRMs, there…

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making tasks across diverse domains, yet its reliance on black-box neural architectures hinders interpretability, trust, and deployment in high-stakes…

机器学习 · 计算机科学 2025-02-12 Zelei Cheng , Jiahao Yu , Xinyu Xing

Reinforcement Learning with Verifiable Rewards (RLVR) is an effective paradigm for improving the reasoning capabilities of large language models. However, existing RLVR methods utilize rollouts in an indiscriminate and short-horizon manner:…

机器学习 · 计算机科学 2026-05-26 Xiaodong Lu , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Zhijun Chen , Yu Luo , Fuzhen Zhuang , Yikun Ban , Deqing Wang

Large reasoning models (LRMs) extend large language models by generating explicit chain-of-thought (CoT) reasoning, significantly improving mathematical and logical problem solving. However, this explicit reasoning process also introduces…

计算与语言 · 计算机科学 2025-12-02 Jinghan Jia , Nathalie Baracaldo , Sijia Liu

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

Recent advances in vision-language models (VLMs) have improved Chest X-ray (CXR) interpretation in multiple aspects. However, many medical VLMs rely solely on supervised fine-tuning (SFT), which optimizes next-token prediction without…

While recent advances have boosted LM proficiency in linguistic benchmarks, LMs consistently struggle to reason correctly on complex tasks like mathematics. We turn to Reinforcement Learning from Human Feedback (RLHF) as a method with which…

计算与语言 · 计算机科学 2023-11-13 Sarah Pan , Vladislav Lialin , Sherin Muckatira , Anna Rumshisky

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates promising potential in advancing the reasoning capabilities of LLMs. However, its success remains largely confined to mathematical and code domains. This primary limitation…

机器学习 · 计算机科学 2025-06-24 Tianyu Yu , Bo Ji , Shouli Wang , Shu Yao , Zefan Wang , Ganqu Cui , Lifan Yuan , Ning Ding , Yuan Yao , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

When language models (LMs) are trained via reinforcement learning (RL) to generate natural language "reasoning chains", their performance improves on a variety of difficult question answering tasks. Today, almost all successful applications…

机器学习 · 计算机科学 2026-05-18 Mehul Damani , Isha Puri , Stewart Slocum , Idan Shenfeld , Leshem Choshen , Yoon Kim , Jacob Andreas

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Large language models have achieved significant reasoning improvements through reinforcement learning with verifiable rewards (RLVR). Yet as model capabilities grow, constructing high-quality reward signals becomes increasingly difficult,…

机器学习 · 计算机科学 2026-04-21 Salman Rahman , Jingyan Shen , Anna Mordvina , Hamid Palangi , Saadia Gabriel , Pavel Izmailov

Humans can quickly learn new behaviors by leveraging background world knowledge. In contrast, agents trained with reinforcement learning (RL) typically learn behaviors from scratch. We thus propose a novel approach that uses the vast…

机器学习 · 计算机科学 2024-05-24 William Chen , Oier Mees , Aviral Kumar , Sergey Levine

Reinforcement Learning with Verifiable Rewards (RLVR) has markedly enhanced the reasoning abilities of large language models (LLMs). Its success, however, largely depends on strong base models with rich world knowledge, yielding only modest…

人工智能 · 计算机科学 2025-08-19 Yongxin Guo , Wenbo Deng , Zhenglin Cheng , Xiaoying Tang

Solving complex geometric problems inherently requires interleaved reasoning: a tight alternation between constructing diagrams and performing logical deductions. Although recent Multimodal Large Language Models (MLLMs) have demonstrated…

Large Language Models (LLMs) demonstrate strong reasoning and self-correction abilities in high-resource languages like English, but their performance remains limited in low-resource languages such as Korean. In this study, we investigate…

计算与语言 · 计算机科学 2026-01-12 Hongjin Kim , Jaewook Lee , Kiyoung Lee , Jong-hun Shin , Soojong Lim , Oh-Woog Kwon

Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated promising gains in enhancing the reasoning capabilities of large language models. However, its dependence on domain-specific verifiers significantly restricts its…

计算与语言 · 计算机科学 2026-01-22 Chongxuan Huang , Lei Lin , Xiaodong Shi , Wenping Hu , Ruiming Tang

Large Language Models (LLMs) show strong reasoning abilities, often amplified by Chain-of-Thought (CoT) prompting and reinforcement learning (RL). Although RL algorithms can substantially improve reasoning, they struggle to expand reasoning…

计算与语言 · 计算机科学 2025-10-07 Xiangchi Yuan , Xiang Chen , Tong Yu , Dachuan Shi , Can Jin , Wenke Lee , Saayan Mitra

Large Reasoning Models (LRMs) still exhibit large performance gaps between English and other languages, yet much current work assumes these gaps can be closed simply by making reasoning in every language resemble English reasoning. This…

计算与语言 · 计算机科学 2026-04-07 Dayeon Ki , Kevin Duh , Marine Carpuat

We propose Reinforcement Learning with Explicit Human Values (RLEV), a method that aligns Large Language Model (LLM) optimization directly with quantifiable human value signals. While Reinforcement Learning with Verifiable Rewards (RLVR)…

机器学习 · 计算机科学 2025-10-24 Dian Yu , Yulai Zhao , Kishan Panaganti , Linfeng Song , Haitao Mi , Dong Yu