中文
相关论文

相关论文: Active exploration in parameterized reinforcement …

200 篇论文

Efficient exploration is one of the main challenges in reinforcement learning (RL). Most existing sample-efficient algorithms assume the existence of a single reward function during exploration. In many practical scenarios, however, there…

机器学习 · 计算机科学 2020-06-18 Xuezhou Zhang , Yuzhe ma , Adish Singla

Offline Reinforcement Learning (RL) aims at learning an optimal control from a fixed dataset, without interactions with the system. An agent in this setting should avoid selecting actions whose consequences cannot be predicted from the…

Reinforcement learning algorithms typically struggle in the absence of a dense, well-shaped reward function. Intrinsically motivated exploration methods address this limitation by rewarding agents for visiting novel states or transitions,…

Many potential applications of reinforcement learning (RL) are stymied by the large numbers of samples required to learn an effective policy. This is especially true when applying RL to real-world control tasks, e.g. in the sciences or…

Selecting exploratory actions that generate a rich stream of experience for better learning is a fundamental challenge in reinforcement learning (RL). An approach to tackle this problem consists in selecting actions according to specific…

机器学习 · 计算机科学 2023-06-12 Martin Klissarov , Marlos C. Machado

Reward-free reinforcement learning (RL) considers the setting where the agent does not have access to a reward function during exploration, but must propose a near-optimal policy for an arbitrary reward function revealed only after…

机器学习 · 计算机科学 2022-06-22 Andrew Wagenmaker , Yifang Chen , Max Simchowitz , Simon S. Du , Kevin Jamieson

Offline reinforcement learning (RL) faces a significant challenge of distribution shift. Model-free offline RL penalizes the Q value for out-of-distribution (OOD) data or constrains the policy closed to the behavior policy to tackle this…

机器学习 · 计算机科学 2024-04-18 Xiao-Yin Liu , Xiao-Hu Zhou , Guotao Li , Hao Li , Mei-Jiang Gui , Tian-Yu Xiang , De-Xing Huang , Zeng-Guang Hou

In online reinforcement learning (RL), efficient exploration remains particularly challenging in high-dimensional environments with sparse rewards. In low-dimensional environments, where tabular parameterization is possible, count-based…

机器学习 · 计算机科学 2021-06-21 Tianjun Zhang , Paria Rashidinejad , Jiantao Jiao , Yuandong Tian , Joseph Gonzalez , Stuart Russell

Real-world applications require RL algorithms to act safely. During learning process, it is likely that the agent executes sub-optimal actions that may lead to unsafe/poor states of the system. Exploration is particularly brittle in…

机器学习 · 统计学 2019-06-17 Elena Smirnova , Elvis Dohmatob , Jérémie Mary

Hybrid action models are widely considered an effective approach to reinforcement learning (RL) modeling. The current mainstream method is to train agents under Parameterized Action Markov Decision Processes (PAMDPs), which performs well in…

机器学习 · 计算机科学 2025-01-07 Zijian Wang , Bin Wang , Mingwen Shao , Hongbo Dou , Boxiang Tao

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

机器学习 · 计算机科学 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Model-based reinforcement learning (RL) is considered to be a promising approach to reduce the sample complexity that hinders model-free RL. However, the theoretical understanding of such methods has been rather limited. This paper…

机器学习 · 计算机科学 2021-02-16 Yuping Luo , Huazhe Xu , Yuanzhi Li , Yuandong Tian , Trevor Darrell , Tengyu Ma

In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its…

机器人学 · 计算机科学 2024-03-19 Yuhong Cao , Rui Zhao , Yizhuo Wang , Bairan Xiang , Guillaume Sartoretti

Understanding the behavior of deep reinforcement learning (DRL) agents -particularly as task and agent sophistication increase- requires more than simple comparison of reward curves, yet standard methods for behavioral analysis remain…

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

机器人学 · 计算机科学 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Navigating and understanding complex and unknown environments autonomously demands more than just basic perception and movement from embodied agents. Truly effective exploration requires agents to possess higher-level cognitive abilities,…

人工智能 · 计算机科学 2025-09-12 Abdel Hakim Drid , Vincenzo Suriani , Daniele Nardi , Abderrezzak Debilou

Exploration is essential for reinforcement learning (RL). To face the challenges of exploration, we consider a reward-free RL framework that completely separates exploration from exploitation and brings new challenges for exploration…

机器学习 · 计算机科学 2020-12-11 Chuheng Zhang , Yuanying Cai , Longbo Huang , Jian Li

Meta reinforcement learning (Meta-RL) is an approach wherein the experience gained from solving a variety of tasks is distilled into a meta-policy. The meta-policy, when adapted over only a small (or just a single) number of steps, is able…

机器学习 · 计算机科学 2022-09-28 Desik Rengarajan , Sapana Chaudhary , Jaewon Kim , Dileep Kalathil , Srinivas Shakkottai

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties. We propose a novel and efficient exploration method for deep RL that has two components. The…

机器学习 · 计算机科学 2019-05-16 Borislav Mavrin , Shangtong Zhang , Hengshuai Yao , Linglong Kong , Kaiwen Wu , Yaoliang Yu

Exploration of indoor environments has recently experienced a significant interest, also thanks to the introduction of deep neural agents built in a hierarchical fashion and trained with Deep Reinforcement Learning (DRL) on simulated…