English
Related papers

Related papers: Efficient Agentic Reinforcement Learning with On-P…

200 papers

Continuous control Deep Reinforcement Learning (RL) approaches are known to suffer from estimation biases, leading to suboptimal policies. This paper introduces innovative methods in RL, focusing on addressing and exploiting estimation…

Machine Learning · Computer Science 2024-10-14 Niccolò Turcato , Alberto Sinigaglia , Alberto Dalla Libera , Ruggero Carli , Gian Antonio Susto

Agentic retrieval-augmented generation (RAG) systems enable large language models (LLMs) to solve complex tasks through multi-step interaction with external retrieval tools. However, such multi-step interaction often involves redundant…

Artificial Intelligence · Computer Science 2026-04-21 Jingbo Sun , Wenyue Chong , Songjun Tu , Qichao Zhang , Yaocheng Zhang , Jiajun Chai , Xiaohan Wang , Wei Lin , Guojun Yin , Dongbin Zhao

Multi-agent debate system (MAD) imitating the process of human discussion in pursuit of truth, aims to align the correct cognition of different agents for the optimal solution. It is challenging to make various agents perform right and…

Computation and Language · Computer Science 2024-07-12 Haotian Wang , Xiyuan Du , Weijiang Yu , Qianglong Chen , Kun Zhu , Zheng Chu , Lian Yan , Yi Guan

Offline reinforcement learning (RL) provides a powerful framework for training robotic agents using pre-collected, suboptimal datasets, eliminating the need for costly, time-consuming, and potentially hazardous online interactions. This is…

Machine Learning · Computer Science 2025-08-01 Tung M. Luu , Donghoon Lee , Younghwan Lee , Chang D. Yoo

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

Computation and Language · Computer Science 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Safe reinforcement learning (RL) agents accomplish given tasks while adhering to specific constraints. Employing constraints expressed via easily-understandable human language offers considerable potential for real-world applications due to…

Machine Learning · Computer Science 2024-05-16 Xingzhou Lou , Junge Zhang , Ziyan Wang , Kaiqi Huang , Yali Du

Reinforcement learning (RL) has demonstrated impressive performance in decision-making tasks like embodied control, autonomous driving and financial trading. In many decision-making tasks, the agents often encounter the problem of executing…

Machine Learning · Computer Science 2024-07-23 Jing-Cheng Pang , Tian Xu , Shengyi Jiang , Yu-Ren Liu , Yang Yu

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao

Deep Reinforcement Learning (RL) is remarkably effective in addressing sequential resource allocation problems in domains such as healthcare, public policy, and resource management. However, deep RL policies often lack transparency and…

Machine Learning · Computer Science 2025-02-18 Mauricio Tec , Guojun Xiong , Haichuan Wang , Francesca Dominici , Milind Tambe

Agentic systems operating over large tool ecosystems must plan and execute long-horizon workflows under weak or non-verifiable supervision. While frontier models mitigate these challenges through scale and large context budgets, small…

Machine Learning · Computer Science 2026-03-10 Karan Gupta , Pranav Vajreshwari , Yash Pandya , Raghav Magazine , Akshay Nambi , Ahmed Awadallah

Reinforcement learning (RL) is an effective technique for training decision-making agents through interactions with their environment. The advent of deep learning has been associated with highly notable successes with sequential decision…

Machine Learning · Computer Science 2021-05-25 Michael Tashman , John Hoffman , Jiayi Xie , Fengdan Ye , Atefeh Morsali , Lee Winikor , Rouzbeh Gerami

Current knowledge-enhanced large language models (LLMs) rely on static, pre-constructed knowledge bases that suffer from coverage gaps and temporal obsolescence, limiting their effectiveness in dynamic information environments. We present…

Machine Learning · Computer Science 2025-10-13 Jing Li , Zhijie Sun , Zhicheng Zhou , Suming Qiu , Junjie Huang , Haijia Sun , Linyuan Qiu

Agentic Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by enabling dynamic, multi-step reasoning and information retrieval. However, these systems often exhibit sub-optimal search behaviors like…

Computation and Language · Computer Science 2025-10-10 Peilin Wu , Mian Zhang , Xinlu Zhang , Xinya Du , Zhiyu Zoey Chen

Attacks on machine learning models have been extensively studied through stateless optimization. In this paper, we demonstrate how a reinforcement learning (RL) agent can learn a new class of attack algorithms that generate adversarial…

Cryptography and Security · Computer Science 2025-11-20 Kyle Domico , Jean-Charles Noirot Ferrand , Ryan Sheatsley , Eric Pauley , Josiah Hanna , Patrick McDaniel

Reinforcement learning (RL) has recently become the core paradigm for aligning and strengthening large language models (LLMs). Yet, applying RL in off-policy settings--where stale data from past policies are used for training--improves…

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

Machine Learning · Computer Science 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

The functionality of Large Language Model (LLM) agents is primarily determined by two capabilities: action planning and answer summarization. The former, action planning, is the core capability that dictates an agent's performance. However,…

Machine Learning · Computer Science 2025-08-28 Zhiwei Li , Yong Hu , Wenqing Wang

Large Language Models (LLMs) often struggle with dynamically changing knowledge and handling unknown static information. Retrieval-Augmented Generation (RAG) is employed to tackle these challenges and has a significant impact on improving…

Computation and Language · Computer Science 2025-09-18 Zhen Zhang , Xinyu Wang , Yong Jiang , Zile Qiao , Zhuo Chen , Guangyu Li , Feiteng Mu , Mengting Hu , Pengjun Xie , Fei Huang

The past years have seen Large Language Models (LLMs) strive not only as generative models but also as agents solving textual sequential decision-making tasks. When facing complex environments where their zero-shot abilities are…

Machine Learning · Computer Science 2026-01-30 Loris Gaven , Clement Romac , Thomas Carta , Sylvain Lamprier , Olivier Sigaud , Pierre-Yves Oudeyer

Standard reinforcement learning (RL) algorithms assume that the observation of the next state comes instantaneously and at no cost. In a wide variety of sequential decision making tasks ranging from medical treatment to scientific…

Artificial Intelligence · Computer Science 2020-05-27 Colin Bellinger , Rory Coles , Mark Crowley , Isaac Tamblyn