中文
相关论文

相关论文: Never Explore Repeatedly in Multi-Agent Reinforcem…

200 篇论文

Reward maximization, safe exploration, and intrinsic motivation are often studied as separate objectives in reinforcement learning (RL). We present a unified geometric framework, that views these goals as instances of a single optimization…

机器学习 · 计算机科学 2025-09-03 Nikola Milosevic , Nico Scherf

Exploration is a key problem in reinforcement learning, since agents can only learn from data they acquire in the environment. With that in mind, maintaining a population of agents is an attractive method, as it allows data be collected…

机器学习 · 计算机科学 2020-10-08 Jack Parker-Holder , Aldo Pacchiano , Krzysztof Choromanski , Stephen Roberts

To rapidly learn a new task, it is often essential for agents to explore efficiently -- especially when performance matters from the first timestep. One way to learn such behaviour is via meta-learning. Many existing methods however rely on…

机器学习 · 计算机科学 2021-06-11 Luisa Zintgraf , Leo Feng , Cong Lu , Maximilian Igl , Kristian Hartikainen , Katja Hofmann , Shimon Whiteson

The explore{exploit dilemma is one of the central challenges in Reinforcement Learning (RL). Bayesian RL solves the dilemma by providing the agent with information in the form of a prior distribution over environments; however, full…

机器学习 · 计算机科学 2012-03-19 Jonathan Sorg , Satinder Singh , Richard L. Lewis

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when…

机器人学 · 计算机科学 2022-10-25 Tim Schneider , Boris Belousov , Georgia Chalvatzaki , Diego Romeres , Devesh K. Jha , Jan Peters

Learning in sparse reward settings remains a challenge in Reinforcement Learning, which is often addressed by using intrinsic rewards. One promising strategy is inspired by human curiosity, requiring the agent to learn to predict the…

机器学习 · 计算机科学 2018-10-02 Gino Brunner , Manuel Fritsche , Oliver Richter , Roger Wattenhofer

Modern reinforcement learning (RL) struggles to capture real-world cause-and-effect dynamics, leading to inefficient exploration due to extensive trial-and-error actions. While recent efforts to improve agent exploration have leveraged…

机器学习 · 计算机科学 2024-07-18 Minh Hoang Nguyen , Hung Le , Svetha Venkatesh

Obtaining a survival strategy (policy) is one of the fundamental problems of biological agents. In this paper, we generalize the formulation of previous research related to the survival of an agent and we formulate the survival problem as a…

人工智能 · 计算机科学 2016-07-26 Naoto Yoshida

Maximum entropy reinforcement learning motivates agents to explore states and actions to maximize the entropy of some distribution, typically by providing additional intrinsic rewards proportional to that entropy function. In this paper, we…

机器学习 · 计算机科学 2026-03-20 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

Intrinsic rewards can improve exploration in reinforcement learning, but the exploration process may suffer from instability caused by non-stationary reward shaping and strong dependency on hyperparameters. In this work, we introduce…

机器学习 · 计算机科学 2022-02-10 Lukas Schäfer , Filippos Christianos , Josiah P. Hanna , Stefano V. Albrecht

We consider the problem of reward learning for temporally extended tasks. For reward learning, inverse reinforcement learning (IRL) is a widely used paradigm. Given a Markov decision process (MDP) and a set of demonstrations for a task, IRL…

机器人学 · 计算机科学 2021-07-14 Farzan Memarian , Zhe Xu , Bo Wu , Min Wen , Ufuk Topcu

Multiagent reinforcement learning (MARL) is commonly considered to suffer from non-stationary environments and exponentially increasing policy space. It would be even more challenging when rewards are sparse and delayed over long…

Exploration in sparse reward reinforcement learning remains an open challenge. Many state-of-the-art methods use intrinsic motivation to complement the sparse extrinsic reward signal, giving the agent more opportunities to receive feedback…

机器学习 · 计算机科学 2019-06-24 Jingwei Zhang , Niklas Wetzel , Nicolai Dorka , Joschka Boedecker , Wolfram Burgard

An effective approach to exploration in reinforcement learning is to rely on an agent's uncertainty over the optimal policy, which can yield near-optimal exploration strategies in tabular settings. However, in non-tabular settings that…

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

机器学习 · 计算机科学 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

Balancing exploration and exploitation remains a key challenge in reinforcement learning (RL). State-of-the-art RL algorithms suffer from high sample complexity, particularly in the sparse reward case, where they can do no better than to…

机器学习 · 计算机科学 2020-01-22 Philippe Morere , Gilad Francis , Tom Blau , Fabio Ramos

Balancing exploration and exploitation is a fundamental part of reinforcement learning, yet most state-of-the-art algorithms use a naive exploration protocol like $\epsilon$-greedy. This contributes to the problem of high sample complexity,…

机器学习 · 计算机科学 2019-11-21 Tom Blau , Lionel Ott , Fabio Ramos

Inverse optimal control, also known as inverse reinforcement learning, is the problem of recovering an unknown reward function in a Markov decision process from expert demonstrations of the optimal policy. We introduce a probabilistic…

机器学习 · 计算机科学 2012-06-22 Sergey Levine , Vladlen Koltun

The aim of this paper is to study the reward based policy exploration problem in a supervised learning approach and enable robots to form complex movement trajectories in challenging reward settings and search spaces. For this, the…

机器人学 · 计算机科学 2020-11-10 M. Tuluhan Akbulut , Utku Bozdogan , Ahmet Tekden , Emre Ugur

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

机器人学 · 计算机科学 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur