中文
相关论文

相关论文: TOP-ERL: Transformer-based Off-Policy Episodic Rei…

200 篇论文

Recent advancements in deep reinforcement learning (RL) have demonstrated notable progress in sample efficiency, spanning both model-based and model-free paradigms. Despite the identification and mitigation of specific bottlenecks in prior…

机器学习 · 计算机科学 2024-04-02 Yibo Wang , Jiang Zhao

Reinforcement learning (RL) algorithms such as PPO and GRPO are widely used to train large language models (LLMs) for multi-turn agentic tasks. However, in off-policy training pipelines, these methods often exhibit unstable optimization…

Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement…

神经与进化计算 · 计算机科学 2023-02-01 Lan Tang , Xiaxi Li , Jinyuan Zhang , Guiying Li , Peng Yang , Ke Tang

Offline reinforcement learning (ORL) holds great promise for robot learning due to its ability to learn from arbitrary pre-generated experience. However, current ORL benchmarks are almost entirely in simulation and utilize contrived…

机器人学 · 计算机科学 2022-10-14 Gaoyue Zhou , Liyiming Ke , Siddhartha Srinivasa , Abhinav Gupta , Aravind Rajeswaran , Vikash Kumar

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

人工智能 · 计算机科学 2025-01-28 Alberto Castagna

We consider off-dynamics reinforcement learning (RL) where one needs to transfer policies across different domains with dynamics mismatch. Despite the focus on developing dynamics-aware algorithms, this field is hindered due to the lack of…

机器学习 · 计算机科学 2024-10-29 Jiafei Lyu , Kang Xu , Jiacheng Xu , Mengbei Yan , Jingwen Yang , Zongzhang Zhang , Chenjia Bai , Zongqing Lu , Xiu Li

Offline reinforcement learning (RL) defines the task of learning from a fixed batch of data. Due to errors in value estimation from out-of-distribution actions, most offline RL algorithms take the approach of constraining or regularizing…

机器学习 · 计算机科学 2021-12-06 Scott Fujimoto , Shixiang Shane Gu

Offline reinforcement learning (RL) aims at learning policies from previously collected static trajectory data without interacting with the real environment. Recent works provide a novel perspective by viewing offline RL as a generic…

机器学习 · 计算机科学 2022-10-19 Kerong Wang , Hanye Zhao , Xufang Luo , Kan Ren , Weinan Zhang , Dongsheng Li

Reinforcement learning is a powerful approach to learn behaviour through interactions with an environment. However, behaviours are usually learned in a purely reactive fashion, where an appropriate action is selected based on an…

机器学习 · 计算机科学 2021-06-10 André Biedenkapp , Raghu Rajan , Frank Hutter , Marius Lindauer

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

机器学习 · 计算机科学 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

Deep reinforcement learning (DRL) has been used to learn effective heuristics for solving complex combinatorial optimisation problem via policy networks and have demonstrated promising performance. Existing works have focused on solving…

机器学习 · 计算机科学 2020-12-25 Nasrin Sultana , Jeffrey Chan , A. K. Qin , Tabinda Sarwar

In this work, we present Transitive Reinforcement Learning (TRL), a new value learning algorithm based on a divide-and-conquer paradigm. TRL is designed for offline goal-conditioned reinforcement learning (GCRL) problems, where the aim is…

机器学习 · 计算机科学 2026-02-24 Seohong Park , Aditya Oberai , Pranav Atreya , Sergey Levine

This paper presents a technique for trajectory planning based on continuously parameterized high-level actions (motion primitives) of variable duration. This technique leverages deep reinforcement learning (Deep RL) to formulate a policy…

Approaches based on generative adversarial networks for imitation learning are promising because they are sample efficient in terms of expert demonstrations. However, training a generator requires many interactions with the actual…

机器学习 · 计算机科学 2022-09-01 Eiji Uchibe

Existing off-policy reinforcement learning algorithms often rely on an explicit state-action-value function representation, which can be problematic in high-dimensional action spaces due to the curse of dimensionality. This reliance results…

机器学习 · 计算机科学 2025-02-18 Fabian Otto , Philipp Becker , Ngo Anh Vien , Gerhard Neumann

Large language model (LLM) agents have demonstrated strong capabilities in complex interactive decision-making tasks. However, existing LLM agents typically rely on increasingly long interaction histories, resulting in high computational…

人工智能 · 计算机科学 2026-04-16 Shuai Zhen , Yanhua Yu , Ruopei Guo , Nan Cheng , Yang Deng

Learning optimal behavior from existing data is one of the most important problems in Reinforcement Learning (RL). This is known as "off-policy control" in RL where an agent's objective is to compute an optimal policy based on the data…

机器学习 · 计算机科学 2022-06-16 Raghuram Bharadwaj Diddigi , Prateek Jain , Prabuchandran K. J. , Shalabh Bhatnagar

Applying probabilistic models to reinforcement learning (RL) enables the application of powerful optimisation tools such as variational inference to RL. However, existing inference frameworks and their algorithms pose significant challenges…

机器学习 · 计算机科学 2020-07-17 Matthew Fellows , Anuj Mahajan , Tim G. J. Rudner , Shimon Whiteson

This study proposes the use of a social learning method to estimate a global state within a multi-agent off-policy actor-critic algorithm for reinforcement learning (RL) operating in a partially observable environment. We assume that the…

机器学习 · 计算机科学 2024-07-09 Ainur Zhaikhan , Ali H. Sayed

Autonomous driving has achieved significant progress in recent years, but autonomous cars are still unable to tackle high-risk situations where a potential accident is likely. In such near-accident scenarios, even a minor change in the…

机器学习 · 计算机科学 2020-07-02 Zhangjie Cao , Erdem Bıyık , Woodrow Z. Wang , Allan Raventos , Adrien Gaidon , Guy Rosman , Dorsa Sadigh