English
Related papers

Related papers: Hereditary Geometric Meta-RL: Nonlocal Generalizat…

200 papers

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

Machine Learning · Computer Science 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

In this work we study generalization of neural networks in gradient-based meta-learning by analyzing various properties of the objective landscapes. We experimentally demonstrate that as meta-training progresses, the meta-test solutions,…

Machine Learning · Computer Science 2019-07-18 Simon Guiroy , Vikas Verma , Christopher Pal

Open-endedness stands to benefit from the ability to generate an infinite variety of diverse, challenging environments. One particularly interesting type of challenge is meta-learning ("learning-to-learn"), a hallmark of intelligent…

Machine Learning · Computer Science 2023-12-12 Thomas Miconi

We provide a framework for accelerating reinforcement learning (RL) algorithms by heuristics constructed from domain knowledge or offline data. Tabula rasa RL algorithms require environment interactions or computation that scales with the…

Machine Learning · Computer Science 2021-11-23 Ching-An Cheng , Andrey Kolobov , Adith Swaminathan

Learning from small data sets is critical in many practical applications where data collection is time consuming or expensive, e.g., robotics, animal experiments or drug design. Meta learning is one way to increase the data efficiency of…

Machine Learning · Statistics 2018-07-10 Steindór Sæmundsson , Katja Hofmann , Marc Peter Deisenroth

Purpose: This work aims at developing a generalizable MRI reconstruction model in the meta-learning framework. The standard benchmarks in meta-learning are challenged by learning on diverse task distributions. The proposed network learns…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Wanyu Bian , Yunmei Chen , Xiaojing Ye , Qingchao Zhang

We study the offline meta-reinforcement learning (OMRL) problem, a paradigm which enables reinforcement learning (RL) algorithms to quickly adapt to unseen tasks without any interactions with the environments, making RL truly practical in…

Machine Learning · Computer Science 2021-05-07 Lanqing Li , Rui Yang , Dijun Luo

Meta-learning is a tool that allows us to build sample-efficient learning systems. Here we show that, once meta-trained, LSTM Meta-Learners aren't just faster learners than their sample-inefficient deep learning (DL) and reinforcement…

Machine Learning · Computer Science 2019-05-07 Neil C. Rabinowitz

In spite of the success of existing meta reinforcement learning methods, they still have difficulty in learning a meta policy effectively for RL problems with sparse reward. In this respect, we develop a novel meta reinforcement learning…

Machine Learning · Computer Science 2021-06-08 Yun Hua , Xiangfeng Wang , Bo Jin , Wenhao Li , Junchi Yan , Xiaofeng He , Hongyuan Zha

Modern meta-reinforcement learning (Meta-RL) methods are mainly developed based on model-agnostic meta-learning, which performs policy gradient steps across tasks to maximize policy performance. However, the gradient conflict problem is…

Artificial Intelligence · Computer Science 2022-09-22 Haozhi Wang , Qing Wang , Yunfeng Shao , Dong Li , Jianye Hao , Yinchuan Li

Meta reinforcement learning (meta-RL) aims to learn a policy solving a set of training tasks simultaneously and quickly adapting to new tasks. It requires massive amounts of data drawn from training tasks to infer the common structure…

Machine Learning · Computer Science 2022-07-21 Yijie Guo , Qiucheng Wu , Honglak Lee

Generalization and sample efficiency have been long-standing issues concerning reinforcement learning, and thus the field of Offline Meta-Reinforcement Learning~(OMRL) has gained increasing attention due to its potential of solving a wide…

Machine Learning · Computer Science 2023-12-27 Renzhe Zhou , Chen-Xiao Gao , Zongzhang Zhang , Yang Yu

This work introduces a neuro-symbolic agent that combines deep reinforcement learning (DRL) with temporal logic (TL) to achieve systematic zero-shot, i.e., never-seen-before, generalisation of formally specified instructions. In particular,…

Machine Learning · Computer Science 2021-09-14 Borja G. León , Murray Shanahan , Francesco Belardinelli

Gradient-based meta-learners such as Model-Agnostic Meta-Learning (MAML) have shown strong few-shot performance in supervised and reinforcement learning settings. However, specifically in the case of meta-reinforcement learning (meta-RL),…

Machine Learning · Computer Science 2020-02-20 Bhairav Mehta , Tristan Deleu , Sharath Chandra Raparthy , Chris J. Pal , Liam Paull

In this paper we explore methods to exploit symmetries for ensuring sample efficiency in reinforcement learning (RL), this problem deserves ever increasing attention with the recent advances in the use of deep networks for complex RL tasks…

Machine Learning · Statistics 2017-06-12 Anuj Mahajan , Theja Tulabandhula

Typical reinforcement learning (RL) agents learn to complete tasks specified by reward functions tailored to their domain. As such, the policies they learn do not generalize even to similar domains. To address this issue, we develop a…

Artificial Intelligence · Computer Science 2017-05-26 Himanshu Sahni , Saurabh Kumar , Farhan Tejani , Yannick Schroecker , Charles Isbell

Meta-reinforcement learning algorithms can enable robots to acquire new skills much more quickly, by leveraging prior experience to learn how to learn. However, much of the current research on meta-reinforcement learning focuses on task…

Meta learning have achieved promising performance in low-resource text classification which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. However, due to the limited…

Computation and Language · Computer Science 2023-09-12 Rongsheng Li , Yangning Li , Yinghui Li , Chaiyut Luoyiching , Hai-Tao Zheng , Nannan Zhou , Hanjing Su

Learning generalist embodied agents, able to solve multitudes of tasks in different domains is a long-standing problem. Reinforcement learning (RL) is hard to scale up as it requires a complex reward design for each task. In contrast,…

Artificial Intelligence · Computer Science 2024-11-01 Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt , Aaron Courville , Sai Rajeswar

Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to generalize across…

Machine Learning · Computer Science 2023-05-30 Boyuan Chen , Chuning Zhu , Pulkit Agrawal , Kaiqing Zhang , Abhishek Gupta