English
Related papers

Related papers: Reward Learning for Efficient Reinforcement Learni…

200 papers

Continuous Integration (CI) significantly reduces integration problems, speeds up development time, and shortens release time. However, it also introduces new challenges for quality assurance activities, including regression testing, which…

Software Engineering · Computer Science 2021-03-29 Mojtaba Bagherzadeh , Nafiseh Kahani , Lionel Briand

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for complex reasoning tasks with clear correctness signals such as math and coding. However, extending it to real-world reasoning tasks is challenging, as evaluation…

Machine Learning · Computer Science 2025-10-06 Anisha Gunjal , Anthony Wang , Elaine Lau , Vaskar Nath , Yunzhong He , Bing Liu , Sean Hendryx

Document summarization condenses a long document into a short version with salient information and accurate semantic descriptions. The main issue is how to make the output summary semantically consistent with the input document. To reach…

Computation and Language · Computer Science 2022-04-01 Mingyang Song , Liping Jing

Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing generalizable reward functions. In this paper, we propose a…

Robotics · Computer Science 2026-03-24 Yanru Wu , Weiduo Yuan , Ang Qi , Vitor Guizilini , Jiageng Mao , Yue Wang

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ya-Qi Yu , Hao Wang , Fangyu Hong , Xiangyang Qu , Gaojie Wu , Qiaoyu Luo , Nuo Xu , Huixin Wang , Wuheng Xu , Yongxin Liao , Zihao Chen , Haonan Li , Ziming Li , Dezhi Peng , Minghui Liao , Jihao Wu , Haoyu Ren , Dandan Tu

We study reinforcement learning (RL) for decision processes with non-Markovian reward, in which high-level knowledge of the task in the form of reward machines is available to the learner. We consider probabilistic reward machines with…

Machine Learning · Computer Science 2024-12-30 Hippolyte Bourel , Anders Jonsson , Odalric-Ambrym Maillard , Chenxiao Ma , Mohammad Sadegh Talebi

Reinforcement learning (RL) methods usually treat reward functions as black boxes. As such, these methods must extensively interact with the environment in order to discover rewards and optimal policies. In most RL applications, however,…

Machine Learning · Computer Science 2022-01-19 Rodrigo Toro Icarte , Toryn Q. Klassen , Richard Valenzano , Sheila A. McIlraith

Reward-free reinforcement learning (RL) is a framework which is suitable for both the batch RL setting and the setting where there are many reward functions of interest. During the exploration phase, an agent collects samples without using…

Machine Learning · Computer Science 2020-06-22 Ruosong Wang , Simon S. Du , Lin F. Yang , Ruslan Salakhutdinov

Large language models (LLMs) have demonstrated impressive capabilities in reasoning with the emergence of reasoning models like OpenAI-o1 and DeepSeek-R1. Recent research focuses on integrating reasoning capabilities into the realm of…

Computation and Language · Computer Science 2025-05-26 Qi Zhang , Shouqing Yang , Lirong Gao , Hao Chen , Xiaomeng Hu , Jinglei Chen , Jiexiang Wang , Sheng Guo , Bo Zheng , Haobo Wang , Junbo Zhao

Text summarization is a crucial task that requires the simultaneous optimization of multiple objectives, including consistency, coherence, relevance, and fluency, which presents considerable challenges. Although large language models (LLMs)…

Computation and Language · Computer Science 2025-10-23 Junjie Song , Yiwen Liu , Dapeng Li , Yin Sun , Shukun Fu , Siqi Chen , Yuji Cao

Resource allocation plays a critical role in minimizing cycle time and improving the efficiency of business processes. Recently, Deep Reinforcement Learning (DRL) has emerged as a powerful technique to optimize resource allocation policies…

Machine Learning · Computer Science 2025-09-03 Jeroen Middelhuis , Zaharah Bukhsh , Ivo Adan , Remco Dijkman

Reinforcement learning (RL) has enhanced the capabilities of large language models (LLMs) through reward-driven training. Nevertheless, this process can introduce excessively long responses, inflating inference latency and computational…

Machine Learning · Computer Science 2026-02-17 Chang Liu , Yiran Zhao , Lawrence Liu , Yaoqi Ye , Csaba Szepesvári , Lin F. Yang

Static feature exclusion strategies often fail to prevent bias when hidden dependencies influence the model predictions. To address this issue, we explore a reinforcement learning (RL) framework that integrates bias mitigation and automated…

Machine Learning · Computer Science 2025-10-14 Sudip Khadka , L. S. Paudel

Through reinforcement learning (RL) with outcome correctness rewards, large reasoning models (LRMs) with scaled inference computation have demonstrated substantial success on complex reasoning tasks. However, the one-sided reward, focused…

Computation and Language · Computer Science 2025-11-21 Jiashu Yao , Heyan Huang , Shuang Zeng , Chuwei Luo , WangJie You , Jie Tang , Qingsong Liu , Yuhang Guo , Yangyang Kang

While reinforcement learning with verifiable rewards (RLVR) has advanced LLM reasoning in structured domains like mathematics and programming, its application to general-domain reasoning tasks remains challenging due to the absence of…

Computation and Language · Computer Science 2026-01-29 Wenlin Zhong , Chengyuan Liu , Yiquan Wu , Bovin Tan , Changlong Sun , Yi Wang , Xiaozhong Liu , Kun Kuang

Reinforcement learning (RL) has become a central paradigm for post-training large language models (LLMs), particularly for complex reasoning tasks, yet it often suffers from exploration collapse: policies prematurely concentrate on a small…

Machine Learning · Computer Science 2026-01-16 Zhiyuan Hu , Yucheng Wang , Yufei He , Jiaying Wu , Yilun Zhao , See-Kiong Ng , Cynthia Breazeal , Anh Tuan Luu , Hae Won Park , Bryan Hooi

Reinforcement Learning (RL) methods have emerged as a popular choice for training an efficient and effective dialogue policy. However, these methods suffer from sparse and unstable reward signals returned by a user simulator only when a…

Artificial Intelligence · Computer Science 2020-09-18 Ziming Li , Sungjin Lee , Baolin Peng , Jinchao Li , Julia Kiseleva , Maarten de Rijke , Shahin Shayandeh , Jianfeng Gao

Reinforcement learning (RL) requires skillful definition and remarkable computational efforts to solve optimization and control problems, which could impair its prospect. Introducing human guidance into reinforcement learning is a promising…

Machine Learning · Computer Science 2022-11-30 Jingda Wu , Zhiyu Huang , Wenhui Huang , Chen Lv

Reinforcement learning (RL) has proven effective for fine-tuning large language models (LLMs), significantly enhancing their reasoning abilities in domains such as mathematics and code generation. A crucial factor influencing RL fine-tuning…

Artificial Intelligence · Computer Science 2025-10-31 Xiaoyin Chen , Jiarui Lu , Minsu Kim , Dinghuai Zhang , Jian Tang , Alexandre Piché , Nicolas Gontier , Yoshua Bengio , Ehsan Kamalloo

Reinforcement learning (rl) is a popular paradigm for sequential decision making problems. The past decade's advances in rl have led to breakthroughs in many challenging domains such as video games, board games, robotics, and chip design.…

Machine Learning · Computer Science 2022-11-01 Yanick Schraner