English
Related papers

Related papers: Meta-Learning and Meta-Reinforcement Learning -- T…

200 papers

Animals have remarkable abilities to adapt locomotion to different terrains and tasks. However, robots trained by means of reinforcement learning are typically able to solve only a single task and a transferred policy is usually inferior to…

Robotics · Computer Science 2021-07-09 Arsen Kuzhamuratov , Dmitry Sorokin , Alexander Ulanov , A. I. Lvovsky

Despite recent success of deep network-based Reinforcement Learning (RL), it remains elusive to achieve human-level efficiency in learning novel tasks. While previous efforts attempt to address this challenge using meta-learning strategies,…

Machine Learning · Computer Science 2022-05-03 Haozhe Wang , Jiale Zhou , Xuming He

Foundation models have shown impressive adaptation and scalability in supervised and self-supervised learning problems, but so far these successes have not fully translated to reinforcement learning (RL). In this work, we demonstrate that…

In recent years, meta-learning, in which a model is trained on a family of tasks (i.e. a task distribution), has emerged as an approach to training neural networks to perform tasks that were previously assumed to require structured…

Machine Learning · Computer Science 2021-03-19 Sreejan Kumar , Ishita Dasgupta , Jonathan D. Cohen , Nathaniel D. Daw , Thomas L. Griffiths

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

Machine Learning · Statistics 2020-09-10 Heinke Hihn , Daniel A. Braun

In this report we review memory-based meta-learning as a tool for building sample-efficient strategies that learn from past experience to adapt to any task within a target class. Our goal is to equip the reader with the conceptual…

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

Learning from small data sets is critical in many practical applications where data collection is time consuming or expensive, e.g., robotics, animal experiments or drug design. Meta learning is one way to increase the data efficiency of…

Machine Learning · Statistics 2018-07-10 Steindór Sæmundsson , Katja Hofmann , Marc Peter Deisenroth

Meta learning has attracted much attention recently in machine learning community. Contrary to conventional machine learning aiming to learn inherent prediction rules to predict labels for new query data, meta learning aims to learn the…

Machine Learning · Computer Science 2023-07-04 Jun Shu , Deyu Meng , Zongben Xu

Meta-learning algorithms aim to learn two components: a model that predicts targets for a task, and a base learner that quickly updates that model when given examples from a new task. This additional level of learning can be powerful, but…

Machine Learning · Computer Science 2020-11-05 Janarthanan Rajendran , Alex Irpan , Eric Jang

Team adaptation to new cooperative tasks is a hallmark of human intelligence, which has yet to be fully realized in learning agents. Previous work on multi-agent transfer learning accommodate teams of different sizes, heavily relying on the…

Artificial Intelligence · Computer Science 2022-03-10 Rongjun Qin , Feng Chen , Tonghan Wang , Lei Yuan , Xiaoran Wu , Zongzhang Zhang , Chongjie Zhang , Yang Yu

Neural networks have been successfully applied in applications with a large amount of labeled data. However, the task of rapid generalization on new concepts with small training data while preserving performances on previously learned ones…

Machine Learning · Computer Science 2017-06-09 Tsendsuren Munkhdalai , Hong Yu

We propose a novel and flexible approach to meta-learning for learning-to-learn from only a few examples. Our framework is motivated by actor-critic reinforcement learning, but can be applied to both reinforcement and supervised learning.…

Machine Learning · Computer Science 2017-06-30 Flood Sung , Li Zhang , Tao Xiang , Timothy Hospedales , Yongxin Yang

The cooperation among AI systems, and between AI systems and humans is becoming increasingly important. In various real-world tasks, an agent needs to cooperate with unknown partner agent types. This requires the agent to assess the…

Machine Learning · Computer Science 2021-10-05 Antti Keurulainen , Isak Westerlund , Ariel Kwiatkowski , Samuel Kaski , Alexander Ilin

Autonomous robots need to be able to adapt to unforeseen situations and to acquire new skills through trial and error. Reinforcement learning in principle offers a suitable methodological framework for this kind of autonomous learning.…

Robotics · Computer Science 2016-08-02 Nikolas J. Hemion

Although deep reinforcement learning has recently been very successful at learning complex behaviors, it requires a tremendous amount of data to learn a task. One of the fundamental reasons causing this limitation lies in the nature of the…

Robotics · Computer Science 2022-09-19 Zhenshan Bing , Alexander Koch , Xiangtong Yao , Kai Huang , Alois Knoll

Humans can continuously learn new knowledge. However, machine learning models suffer from drastic dropping in performance on previous tasks after learning new tasks. Cognitive science points out that the competition of similar knowledge is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Runqi Wang , Yuxiang Bao , Baochang Zhang , Jianzhuang Liu , Wentao Zhu , Guodong Guo

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

We propose an algorithm for meta-learning that is model-agnostic, in the sense that it is compatible with any model trained with gradient descent and applicable to a variety of different learning problems, including classification,…

Machine Learning · Computer Science 2017-07-19 Chelsea Finn , Pieter Abbeel , Sergey Levine

Strong inductive biases give humans the ability to quickly learn to perform a variety of tasks. Although meta-learning is a method to endow neural networks with useful inductive biases, agents trained by meta-learning may sometimes acquire…