English
Related papers

Related papers: Reinforcement Learning Enhanced LLMs: A Survey

200 papers

Latent learning, classically theorized by Tolman, shows that biological agents (e.g., rats) can acquire internal representations of their environment without rewards, enabling rapid adaptation once rewards are introduced. In contrast, from…

Machine Learning · Computer Science 2026-02-02 Jian Xiong , Jingbo Zhou , Zihan Zhou , Yixiong Xiao , Le Zhang , Jingyong Ye , Rui Qian , Yang Zhou , Dejing Dou

Reward models (RMs), which are central to existing post-training methods, aim to align LLM outputs with human values by providing feedback signals during fine-tuning. However, existing RMs struggle to capture nuanced, user-specific…

Machine Learning · Computer Science 2025-08-21 Mengdi Li , Guanqiao Chen , Xufeng Zhao , Haochen Wen , Shu Yang , Di Wang

Reinforcement Learning (RL) plays an important role in the robotic manipulation domain since it allows self-learning from trial-and-error interactions with the environment. Still, sample efficiency and reward specification seriously limit…

Robotics · Computer Science 2023-11-07 Kun Chu , Xufeng Zhao , Cornelius Weber , Mengdi Li , Stefan Wermter

Reinforcement learning (RL) with large language models shows promise in complex reasoning. However, its progress is hindered by the lack of large-scale training data that is sufficiently challenging, contamination-free and verifiable. To…

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Recommender systems have been widely applied in different real-life scenarios to help us find useful information. In particular, Reinforcement Learning (RL) based recommender systems have become an emerging research topic in recent years,…

Information Retrieval · Computer Science 2023-06-13 Yuanguo Lin , Yong Liu , Fan Lin , Lixin Zou , Pengcheng Wu , Wenhua Zeng , Huanhuan Chen , Chunyan Miao

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

Information Retrieval · Computer Science 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Reinforcement learning (RL) is often credited with improving language model reasoning and generalization at the expense of degrading memorized knowledge. We challenge this narrative by observing that RL-enhanced models consistently…

Computation and Language · Computer Science 2025-11-11 Renfei Zhang , Manasa Kaniselvan , Niloofar Mireshghallah

Large language models (LLMs) have demonstrated significant potential in enhancing dense retrieval through query augmentation. However, most existing methods treat the LLM and the retriever as separate modules, overlooking the alignment…

Information Retrieval · Computer Science 2025-05-30 Sijia Yao , Pengcheng Huang , Zhenghao Liu , Yu Gu , Yukun Yan , Shi Yu , Ge Yu

Recent advances in applying reinforcement learning (RL) to large language models (LLMs) have led to substantial progress. In particular, a series of remarkable yet often counterintuitive phenomena have been reported in LLMs, exhibiting…

Machine Learning · Computer Science 2025-09-03 Haoze Wu , Cheng Wang , Wenshuo Zhao , Junxian He

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

Reinforcement learning (RL) is an innovative approach to financial decision making, offering specialized solutions to complex investment problems where traditional methods fail. This review analyzes 167 articles from 2017--2025, focusing on…

Computational Finance · Quantitative Finance 2025-12-12 Mohammad Rezoanul Hoque , Md Meftahul Ferdaus , M. Kabir Hassan

While reinforcement learning (RL) demonstrated remarkable success in enhancing the reasoning capabilities of language models, the training dynamics of RL in LLMs remain unclear. In this work, we provide an explanation of the RL training…

Machine Learning · Computer Science 2025-09-30 Xingwu Chen , Tianle Li , Difan Zou

The process of meta-learning algorithms from data, instead of relying on manual design, is growing in popularity as a paradigm for improving the performance of machine learning systems. Meta-learning shows particular promise for…

Machine Learning · Computer Science 2025-09-11 Alexander David Goldie , Zilin Wang , Jaron Cohen , Jakob Nicolaus Foerster , Shimon Whiteson

Large Language Models (LLMs) are increasingly being explored for building Agents capable of active environmental interaction (e.g., via tool use) to solve complex problems. Reinforcement Learning (RL) is considered a key technology with…

Computation and Language · Computer Science 2025-11-19 Mingyue Cheng , Jie Ouyang , Shuo Yu , Ruiran Yan , Yucong Luo , Zirui Liu , Daoyu Wang , Qi Liu , Enhong Chen

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

Recent advancements in large language models (LLMs) have led to their increased application across various tasks, with reinforcement learning from human feedback (RLHF) being a crucial part of their training to align responses with user…

Computation and Language · Computer Science 2024-10-29 Ben Hauptvogel , Malte Ostendorff , Georg Rehm , Sebastian Möller

Personalizing large language models (LLMs) to accommodate diverse user preferences is essential for enhancing alignment and user satisfaction. Traditional reinforcement learning from human feedback (RLHF) approaches often rely on monolithic…

Machine Learning · Computer Science 2025-04-22 Avinandan Bose , Zhihan Xiong , Yuejie Chi , Simon Shaolei Du , Lin Xiao , Maryam Fazel

Although Large Audio-Language Models (LALMs) have exhibited outstanding performance in auditory understanding, their performance in affective computing scenarios, particularly in emotion recognition, reasoning, and subtle sentiment…

Sound · Computer Science 2025-09-23 Pengcheng Li , Botao Zhao , Zuheng Kang , Junqing Peng , Xiaoyang Qu , Yayun He , Jianzong Wang

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu