中文
相关论文

相关论文: Rollout Pass-Rate Control: Steering Binary-Reward …

200 篇论文

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

机器人学 · 计算机科学 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Most provably-efficient learning algorithms introduce optimism about poorly-understood states and actions to encourage exploration. We study an alternative approach for efficient exploration, posterior sampling for reinforcement learning…

机器学习 · 统计学 2013-12-30 Ian Osband , Daniel Russo , Benjamin Van Roy

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

机器学习 · 计算机科学 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

Standard reinforcement learning (RL) assumes that an agent can observe a reward for each state-action pair. However, in practical applications, it is often difficult and costly to collect a reward for each state-action pair. While there…

机器学习 · 计算机科学 2025-06-18 Yihan Du , Anna Winnicki , Gal Dalal , Shie Mannor , R. Srikant

Reinforcement learning (RL) in autonomous driving employs a trial-and-error mechanism, enhancing robustness in unpredictable environments. However, crafting effective reward functions remains challenging, as conventional approaches rely…

机器学习 · 计算机科学 2025-06-02 Yongming Chen , Miner Chen , Liewen Liao , Mingyang Jiang , Xiang Zuo , Hengrui Zhang , Yuchen Xi , Songan Zhang

Process Reinforcement Learning~(PRL) has demonstrated considerable potential in enhancing the reasoning capabilities of Large Language Models~(LLMs). However, introducing additional process reward models incurs substantial computational…

机器学习 · 计算机科学 2025-07-04 Wu Fei , Hao Kong , Shuxian Liang , Yang Lin , Yibo Yang , Jing Tang , Lei Chen , Xiansheng Hua

While reinforcement learning has been increasingly applied to stochastic control, few studies have systematically examined policy-based methods in queuing environments modeled as a semi-Markov decision process (SMDP). To address this gap,…

最优化与控制 · 数学 2026-04-28 Joseph Walton , Gabriel Nicolosi

Reinforcement learning with verifiable rewards has become a standard recipe for improving the reasoning abilities of large language models. Existing algorithms face a tradeoff between computational efficiency and sample efficiency in value…

机器学习 · 计算机科学 2026-05-27 Shijin Gong , Erhan Xu , Kai Ye , Francesco Quinzan , Giulia Livieri , Chengchun Shi

This dissertation investigates how reinforcement learning (RL) methods can be designed to be safe, sample-efficient, and robust. Framed through the unifying perspective of contextual-bandit RL, the work addresses two major application…

机器学习 · 计算机科学 2025-10-20 Shashank Gupta

Experience replay \citep{lin1993reinforcement, mnih2015human} is a widely used technique to achieve efficient use of data and improved performance in RL algorithms. In experience replay, past transitions are stored in a memory buffer and…

机器学习 · 计算机科学 2021-12-09 Liran Szlak , Ohad Shamir

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

软件工程 · 计算机科学 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

Reinforcement learning (RL) has become essential for post-training large language models (LLMs) in reasoning tasks. While scaling rollouts can stabilize training and enhance performance, the computational overhead is a critical issue. In…

机器学习 · 计算机科学 2026-03-27 Jiahao Wu , Ning Lu , Shengcai Liu , Kun Wang , Yanting Yang , Li Qing , Ke Tang

Reinforcement learning (RL) for large language models is an energy-intensive endeavor: training can be unstable, and the policy may gradually drift away from its pretrained weights. We present \emph{RLEP}\, -- \,Reinforcement Learning with…

计算与语言 · 计算机科学 2025-07-11 Hongzhi Zhang , Jia Fu , Jingyuan Zhang , Kai Fu , Qi Wang , Fuzheng Zhang , Guorui Zhou

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

软件工程 · 计算机科学 2025-10-08 Yu Zhu

Multi-step agentic reinforcement learning benefits from fine-grained credit assignment, yet existing approaches offer limited options: critic-free methods like GRPO assign a uniform advantage to every action in a trajectory, while learned…

机器学习 · 计算机科学 2026-04-14 Tao Wang , Suhang Zheng , Xiaoxiao Xu

Reinforcement learning with verifiable rewards (RLVR) for Large Reasoning Models hinges on baseline estimation for variance reduction, but existing approaches pay a heavy price: PPO requires a policy-model scale critic, while GRPO needs…

机器学习 · 计算机科学 2026-05-12 Yunho Choi , Jongwon Lim , Woojin Ahn , Minjae Oh , Jeonghoon Shim , Yohan Jo

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

机器人学 · 计算机科学 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

In practice, rigorous reasoning is often a key driver of correct code, while Reinforcement Learning (RL) for code generation often neglects optimizing reasoning quality. Bringing process-level supervision into RL is appealing, but it faces…

软件工程 · 计算机科学 2026-05-06 Lishui Fan , Yu Zhang , Mouxiang Chen , Zhongxin Liu

Reinforcement Learning has suffered from poor reward specification, and issues for reward hacking even in simple enough domains. Preference Based Reinforcement Learning attempts to solve the issue by utilizing binary feedbacks on queried…

人工智能 · 计算机科学 2023-02-20 Mudit Verma , Subbarao Kambhampati

Reinforcement learning (RL) has become a predominant technique to align language models (LMs) with human preferences or promote outputs which are deemed to be desirable by a given reward function. Standard RL approaches optimize average…

机器学习 · 计算机科学 2025-10-27 Stephen Zhao , Aidan Li , Rob Brekelmans , Roger Grosse