English
Related papers

Related papers: Fast Task Inference with Variational Intrinsic Suc…

200 papers

Multiagent reinforcement learning (MARL) is commonly considered to suffer from non-stationary environments and exponentially increasing policy space. It would be even more challenging when rewards are sparse and delayed over long…

We apply recent advances in deep generative modeling to the task of imitation learning from biological agents. Specifically, we apply variations of the variational recurrent neural network model to a multi-agent setting where we learn…

Machine Learning · Computer Science 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood

Unlike quasi-static robotic manipulation tasks like pick-and-place, dynamic tasks such as non-prehensile manipulation pose greater challenges, especially for vision-based control. Successful control requires the extraction of features…

In inverse reinforcement learning (IRL), an agent seeks to replicate expert demonstrations through interactions with the environment. Traditionally, IRL is treated as an adversarial game, where an adversary searches over reward models, and…

Machine Learning · Computer Science 2025-04-23 Arnav Kumar Jain , Harley Wiltzer , Jesse Farebrother , Irina Rish , Glen Berseth , Sanjiban Choudhury

Humans and animals solve a difficult problem much more easily when they are presented with a sequence of problems that starts simple and slowly increases in difficulty. We explore this idea in the context of reinforcement learning. Rather…

Machine Learning · Computer Science 2019-12-06 Jan Malte Lichtenberg , Özgür Şimşek

Inverse reinforcement learning (IRL) is an imitation learning approach to learning reward functions from expert demonstrations. Its use avoids the difficult and tedious procedure of manual reward specification while retaining the…

Machine Learning · Computer Science 2024-03-25 Daulet Baimukashev , Gokhan Alcan , Ville Kyrki

We present AIRS: Automatic Intrinsic Reward Shaping that intelligently and adaptively provides high-quality intrinsic rewards to enhance exploration in reinforcement learning (RL). More specifically, AIRS selects shaping function from a…

Machine Learning · Computer Science 2023-10-13 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

Recent work has uncovered close links between between classical reinforcement learning algorithms, Bayesian filtering, and Active Inference which lets us understand value functions in terms of Bayesian posteriors. An alternative, but less…

Artificial Intelligence · Computer Science 2022-07-21 Beren Millidge , Christopher L Buckley

In the past few years, deep reinforcement learning has been proven to solve problems which have complex states like video games or board games. The next step of intelligent agents would be able to generalize between tasks, and using prior…

Machine Learning · Computer Science 2018-09-05 Shu-Hsuan Hsu , I-Chao Shen , Bing-Yu Chen

Efficient exploration in multi-agent reinforcement learning (MARL) is a challenging problem when receiving only a team reward, especially in environments with sparse rewards. A powerful method to mitigate this issue involves crafting dense…

Machine Learning · Computer Science 2025-07-28 Xuefei Wu , Xiao Yin , Yuanyang Zhu , Chunlin Chen

An autonomous agent embodied in a humanoid robot, in order to learn from the overwhelming flow of raw and noisy sensory, has to effectively reduce the high spatial-temporal data dimensionality. In this paper we propose a novel method of…

Artificial Intelligence · Computer Science 2018-04-11 Wojciech Skaba

Discovering successful coordinated behaviors is a central challenge in Multi-Agent Reinforcement Learning (MARL) since it requires exploring a joint action space that grows exponentially with the number of agents. In this paper, we propose…

Machine Learning · Computer Science 2021-10-14 Ammar Fayad , Majd Ibrahim

We present a temporally extended variation of the successor representation, which we term t-SR. t-SR captures the expected state transition dynamics of temporally extended actions by constructing successor representations over primitive…

Machine Learning · Computer Science 2022-09-27 Matthew J. Sargent , Peter J. Bentley , Caswell Barry , William de Cothi

A fundamental aspect of behaviour is the ability to encode salient features of experience in memory and use these memories, in combination with current sensory information, to predict the best action for each situation such that long-term…

Neural and Evolutionary Computing · Computer Science 2021-06-25 Stephen Kelly , Tatiana Voegerl , Wolfgang Banzhaf , Cedric Gondro

Symbolic regression discovers explicit, interpretable equations without assuming a functional form in advance. A Bayesian approach strengthens this through probability distributions over candidate expressions, thus quantifying uncertainty…

Machine Learning · Computer Science 2026-05-05 James Butterworth , Gevik Grigorian , Alejandro DiazDelaO

Despite significant advances in the field of deep Reinforcement Learning (RL), today's algorithms still fail to learn human-level policies consistently over a set of diverse tasks such as Atari 2600 games. We identify three key challenges…

Reinforcement learning (RL) often struggles in real-world tasks with high-dimensional state spaces and long horizons, where sparse or fixed rewards severely slow down exploration and cause agents to get trapped in local optima. This paper…

Robotics · Computer Science 2026-04-20 Hürkan Şahin , Van Huyen Dang , Erdi Sayar , Alper Yegenoglu , Erdal Kayacan

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

We propose and address a novel few-shot RL problem, where a task is characterized by a subtask graph which describes a set of subtasks and their dependencies that are unknown to the agent. The agent needs to quickly adapt to the task over…

Machine Learning · Computer Science 2020-04-15 Sungryull Sohn , Hyunjae Woo , Jongwook Choi , Honglak Lee

Under sparse extrinsic reward settings, reinforcement learning has remained challenging, despite surging interests in this field. Previous attempts suggest that intrinsic reward can alleviate the issue caused by sparsity. In this article,…

Machine Learning · Computer Science 2023-06-28 Zijian Gao , Kele Xu , Yuanzhao Zhai , Dawei Feng , Bo Ding , XinJun Mao , Huaimin Wang