中文
相关论文

相关论文: When Adaptive Rewards Hurt: Causal Probing and the…

200 篇论文

Alignment is vital for safely deploying large language models (LLMs). Existing techniques are either reward-based (training a reward model on preference pairs and optimizing with reinforcement learning) or reward-free (directly fine-tuning…

计算与语言 · 计算机科学 2026-03-03 Ruoxi Cheng , Haoxuan Ma , Weixin Wang , Ranjie Duan , Jiexi Liu , Xiaoshuang Jia , Simeng Qin , Xiaochun Cao , Yang Liu , Xiaojun Jia

Large language models (LLMs) have demonstrated strong reasoning abilities in mathematical tasks, often enhanced through reinforcement learning (RL). However, RL-trained models frequently produce unnecessarily long reasoning traces -- even…

计算与语言 · 计算机科学 2025-05-27 Jinyan Su , Claire Cardie

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

机器学习 · 计算机科学 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Recent studies have shown that reinforcement learning (RL) models are vulnerable in various noisy scenarios. For instance, the observed reward channel is often subject to noise in practice (e.g., when rewards are collected through sensors),…

机器学习 · 计算机科学 2020-02-04 Jingkang Wang , Yang Liu , Bo Li

Recent advancements in post-training methodologies for large language models (LLMs) have highlighted reinforcement learning (RL) as a critical component for enhancing reasoning. However, the substantial computational costs associated with…

计算与语言 · 计算机科学 2025-07-29 Songjun Tu , Jiahao Lin , Xiangyu Tian , Qichao Zhang , Linjing Li , Yuqian Fu , Nan Xu , Wei He , Xiangyuan Lan , Dongmei Jiang , Dongbin Zhao

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

软件工程 · 计算机科学 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

Recently, we have struck the balance between the information freshness, in terms of age of information (AoI), experienced by users and energy consumed by sensors, by appropriately activating sensors to update their current status in caching…

机器学习 · 计算机科学 2021-04-15 Chao Xu , Yiping Xie , Xijun Wang , Howard H. Yang , Dusit Niyato , Tony Q. S. Quek

In this paper, a deep reinforcement learning (DRL)-based approach to the Lyapunov optimization is considered to minimize the time-average penalty while maintaining queue stability. A proper construction of state and action spaces is…

网络与互联网体系结构 · 计算机科学 2020-12-16 Sohee Bae , Seungyul Han , Youngchul Sung

The success of Deepseek-R1 has drawn the LLM community's attention to reinforcement learning (RL) methods like GRPO. However, such rule-based 0/1 outcome reward methods lack the capability to regulate the intermediate reasoning processes…

人工智能 · 计算机科学 2025-05-26 Muzhi Dai , Shixuan Liu , Qingyi Si

Reinforcement learning with verifiable rewards (RLVR) has become a highly effective method for improving the reasoning abilities of Large Language Models (LLMs). Recent research shows that Negative Sample Reinforcement (NSR) -- which…

机器学习 · 计算机科学 2026-05-11 Yash Ingle , Jaival Chauhan , Ankit Yadav , Sudhakar Mishra

Reinforcement learning with verifiable rewards has driven recent advances in LLM post-training, in particular for reasoning. Policy optimization algorithms generate a number of responses for a given prompt and then effectively weight the…

机器学习 · 计算机科学 2026-02-12 Reinhard Heckel , Mahdi Soltanolkotabi , Christos Thramboulidis

Deep Reinforcement Learning (DRL) has achieved great success in solving complicated decision-making problems. Despite the successes, DRL is frequently criticized for many reasons, e.g., data inefficient, inflexible and intractable reward…

机器学习 · 计算机科学 2023-02-07 Weiqin Chen

Adaptive beam switching is essential for mission-critical military and commercial 6G networks but faces major challenges from high carrier frequencies, user mobility, and frequent blockages. While existing machine learning (ML) solutions…

网络与互联网体系结构 · 计算机科学 2025-12-04 Seyed Bagher Hashemi Natanzi , Zhicong Zhu , Bo Tang

In deep Reinforcement Learning (RL), the learning rate critically influences both stability and performance, yet its optimal value shifts during training as the environment and policy evolve. Standard decay schedulers assume monotonic…

机器学习 · 计算机科学 2025-10-09 Henrique Donâncio , Antoine Barrier , Leah F. South , Florence Forbes

Aligning Large Language Models (LLMs) traditionally relies on costly training and human preference annotations. Self-alignment seeks to reduce these expenses by enabling models to align themselves. To further lower costs and achieve…

计算与语言 · 计算机科学 2024-11-15 Somanshu Singla , Zhen Wang , Tianyang Liu , Abdullah Ashfaq , Zhiting Hu , Eric P. Xing

Deep reinforcement learning (DRL) algorithms can suffer from modeling errors between the simulation and the real world. Many studies use adversarial learning to generate perturbation during training process to model the discrepancy and…

机器学习 · 计算机科学 2024-05-21 Qianmei Liu , Yufei Kuang , Jie Wang

Reinforcement Learning (RL) heavily relies on the careful design of the reward function. However, accurately assigning rewards to each state-action pair in Long-Term Reinforcement Learning (LTRL) tasks remains a significant challenge. As a…

机器学习 · 计算机科学 2025-06-03 Qi Ju , Falin Hei , Zhemei Fang , Yunfeng Luo

Prior work in multi-objective reinforcement learning typically uses linear reward scalarization with fixed weights, which provably fails to capture non-convex Pareto fronts and thus yields suboptimal results. This limitation becomes…

机器学习 · 计算机科学 2026-04-01 Yining Lu , Zilong Wang , Shiyang Li , Xin Liu , Changlong Yu , Qingyu Yin , Zhan Shi , Zixuan Zhang , Meng Jiang

Reward models have been increasingly critical for improving the reasoning capability of LLMs. Existing research has shown that a well-trained reward model can substantially improve model performances at inference time via search. However,…

机器学习 · 计算机科学 2024-11-28 Jiaxuan Gao , Shusheng Xu , Wenjie Ye , Weilin Liu , Chuyi He , Wei Fu , Zhiyu Mei , Guangju Wang , Yi Wu

Recent advances in large language models (LLMs) have shown that reasoning ability can be significantly enhanced through Reinforcement Learning with Verifiable Rewards (RLVR). Group Relative Policy Optimization (GRPO) has emerged as the de…

计算与语言 · 计算机科学 2025-10-13 Jingyu Zhou , Lu Ma , Hao Liang , Chengyu Shen , Bin Cui , Wentao Zhang
‹ 上一页 1 2 3 10 下一页 ›