English
Related papers

Related papers: Finding Useful Predictions by Meta-gradient Descen…

200 papers

Predicting human motion in unstructured and dynamic environments is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose to encode…

Robotics · Computer Science 2019-07-01 Philipp Kratzer , Marc Toussaint , Jim Mainprice

Learning models of artificial intelligence can nowadays perform very well on a large variety of tasks. However, in practice different task environments are best handled by different learning models, rather than a single, universal,…

Artificial Intelligence · Computer Science 2016-05-31 Adi Makmal , Alexey A. Melnikov , Vedran Dunjko , Hans J. Briegel

Understanding the agent's learning process, particularly the factors that contribute to its success or failure post-training, is crucial for comprehending the rationale behind the agent's decision-making process. Prior methods clarify the…

Artificial Intelligence · Computer Science 2024-10-15 Shuang Ao , Simon Khan , Haris Aziz , Flora D. Salim

Active inference is a mathematical framework for understanding how agents (biological or artificial) interact with their environments, enabling continual adaptation and decision-making. It combines Bayesian inference and free energy…

Artificial Intelligence · Computer Science 2024-10-02 Rithvik Prakki

Meta-gradient methods (Xu et al., 2018; Zahavy et al., 2020) offer a promising solution to the problem of hyperparameter selection and adaptation in non-stationary reinforcement learning problems. However, the properties of meta-gradients…

Machine Learning · Computer Science 2022-09-14 Jelena Luketina , Sebastian Flennerhag , Yannick Schroecker , David Abel , Tom Zahavy , Satinder Singh

Multi-agent systems are being increasingly deployed in challenging environments for performing complex tasks such as multi-target tracking, search-and-rescue, and intrusion detection. Notwithstanding the computational limitations of…

Optimization and Control · Mathematics 2017-11-30 Amrit Singh Bedi , Paban Sarma , Ketan Rajawat

Most model-free reinforcement learning methods leverage state representations (embeddings) for generalization, but either ignore structure in the space of actions or assume the structure is provided a priori. We show how a policy can be…

Machine Learning · Computer Science 2019-05-16 Yash Chandak , Georgios Theocharous , James Kostas , Scott Jordan , Philip S. Thomas

Making the right decision in traffic is a challenging task that is highly dependent on individual preferences as well as the surrounding environment. Therefore it is hard to model solely based on expert knowledge. In this work we use Deep…

Machine Learning · Computer Science 2020-02-04 Peter Wolf , Karl Kurzer , Tobias Wingert , Florian Kuhnt , J. Marius Zöllner

An open problem in artificial intelligence is how to learn and represent knowledge that is sufficient for a general agent that needs to solve multiple tasks in a given world. In this work we propose world value functions (WVFs), which are a…

Machine Learning · Computer Science 2022-05-19 Geraud Nangue Tasse , Steven James , Benjamin Rosman

Successor-style representations have many advantages for reinforcement learning: for example, they can help an agent generalize from past experience to new goals, and they have been proposed as explanations of behavioral and neural data…

Machine Learning · Computer Science 2021-03-17 Kianté Brantley , Soroush Mehri , Geoffrey J. Gordon

For an autonomous agent to fulfill a wide range of user-specified goals at test time, it must be able to learn broadly applicable and general-purpose skill repertoires. Furthermore, to provide the requisite level of generality, these skills…

Machine Learning · Computer Science 2018-12-05 Ashvin Nair , Vitchyr Pong , Murtaza Dalal , Shikhar Bahl , Steven Lin , Sergey Levine

We present $\Gamma$-nets, a method for generalizing value function estimation over timescale. By using the timescale as one of the estimator's inputs we can estimate value for arbitrary timescales. As a result, the prediction target for any…

Machine Learning · Computer Science 2020-10-20 Craig Sherstan , Shibhansh Dohare , James MacGlashan , Johannes Günther , Patrick M. Pilarski

The objective of a reinforcement learning agent is to discover better actions through exploration. However, typical exploration techniques aim to maximize rewards, often incurring high costs in both exploration and learning processes. We…

Machine Learning · Computer Science 2024-12-24 Akane Tsuboya , Yu Kono , Tatsuji Takahashi

In this paper, we propose a novel meta-learning method in a reinforcement learning setting, based on evolution strategies (ES), exploration in parameter space and deterministic policy gradients. ES methods are easy to parallelize, which is…

Machine Learning · Computer Science 2019-05-09 Yiming Shen , Kehan Yang , Yufeng Yuan , Simon Cheng Liu

Deploying service robots in our daily life, whether in restaurants, warehouses or hospitals, calls for the need to reason on the interactions happening in dense and dynamic scenes. In this paper, we present and benchmark three new…

Artificial Intelligence · Computer Science 2023-07-04 Sariah Mghames , Luca Castri , Marc Hanheide , Nicola Bellotto

Dynamic Algorithm Configuration (DAC) addresses the challenge of dynamically setting hyperparameters of an algorithm for a diverse set of instances rather than focusing solely on individual tasks. Agents trained with Deep Reinforcement…

Machine Learning · Computer Science 2024-07-19 Carolin Benjamins , Gjorgjina Cenikj , Ana Nikolikj , Aditya Mohan , Tome Eftimov , Marius Lindauer

While deep reinforcement learning excels at solving tasks where large amounts of data can be collected through virtually unlimited interaction with the environment, learning from limited interaction remains a key challenge. We posit that an…

Machine Learning · Computer Science 2021-05-21 Max Schwarzer , Ankesh Anand , Rishab Goel , R Devon Hjelm , Aaron Courville , Philip Bachman

Interactive Machine Learning is concerned with creating systems that operate in environments alongside humans to achieve a task. A typical use is to extend or amplify the capabilities of a human in cognitive or physical ways, requiring the…

Machine Learning · Computer Science 2019-02-05 Miguel Alonso

Machine learning plays an increasingly significant role in many aspects of our lives (including medicine, transportation, security, justice and other domains), making the potential consequences of false predictions increasingly devastating.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Yuval Bahat , Gregory Shakhnarovich

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in the last decades. One of the central challenges of manipulation is partial observability, as the agent usually does…

Robotics · Computer Science 2022-06-22 Tim Schneider , Boris Belousov , Hany Abdulsamad , Jan Peters