English
Related papers

Related papers: Generalization to New Actions in Reinforcement Lea…

200 papers

Reinforcement learning (RL) allows to solve complex tasks such as Go often with a stronger performance than humans. However, the learned behaviors are usually fixed to specific tasks and unable to adapt to different contexts. Here we…

Machine Learning · Computer Science 2020-04-21 Chris Reinke

Machine learning models of visual action recognition are typically trained and tested on data from specific situations where actions are associated with certain objects. It is an open question how action-object associations in the training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Satoshi Tsutsui , Xizi Wang , Guangyuan Weng , Yayun Zhang , David Crandall , Chen Yu

A zero-shot RL agent is an agent that can solve any RL task in a given environment, instantly with no additional planning or learning, after an initial reward-free learning phase. This marks a shift from the reward-centric RL paradigm…

Machine Learning · Computer Science 2023-03-02 Ahmed Touati , Jérémy Rapin , Yann Ollivier

We propose a novel framework for the analysis of learning algorithms that allows us to say when such algorithms can and cannot generalize certain patterns from training data to test data. In particular we focus on situations where the rule…

Computation and Language · Computer Science 2016-05-16 Paul Tupper , Bobak Shahriari

This paper considers the problem of learning a control policy for robot motion planning with zero-shot generalization, i.e., no data collection and policy adaptation is needed when the learned policy is deployed in new environments. We…

Systems and Control · Electrical Eng. & Systems 2024-04-09 Zhenyuan Yuan , Siyuan Xu , Minghui Zhu

Generalization to out of distribution tasks in reinforcement learning is a challenging problem. One successful approach improves generalization by conditioning policies on task or environment descriptions that provide information about the…

Machine Learning · Computer Science 2022-05-27 Kolby Nottingham , Alekhya Pyla , Sameer Singh , Roy Fox

Symbolic planning is a powerful technique to solve complex tasks that require long sequences of actions and can equip an intelligent agent with complex behavior. The downside of this approach is the necessity for suitable symbolic…

Artificial Intelligence · Computer Science 2025-04-25 Daniel Tanneberg , Michael Gienger

This paper studies the problem of generalized zero-shot learning which requires the model to train on image-label pairs from some seen classes and test on the task of classifying new images from both seen and unseen classes. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 He Huang , Changhu Wang , Philip S. Yu , Chang-Dong Wang

Offline zero-shot reinforcement learning (RL) aims to learn agents that optimize unseen reward functions without additional environment interaction. The standard approach to this problem trains task-conditioned policies by sampling task…

Artificial Intelligence · Computer Science 2026-04-29 Nazim Bendib , Nicolas Perrin-Gilbert , Olivier Sigaud

A core issue with learning to optimize neural networks has been the lack of generalization to real world problems. To address this, we describe a system designed from a generalization-first perspective, learning to update optimizer…

Machine Learning · Computer Science 2021-06-09 Diogo Almeida , Clemens Winter , Jie Tang , Wojciech Zaremba

A major bottleneck for developing general reinforcement learning agents is determining rewards that will yield desirable behaviors under various circumstances. We introduce a general mechanism for automatically specifying meaningful…

Machine Learning · Computer Science 2017-11-22 Ashley D. Edwards , Charles L. Isbell

Learning policies that generalize across multiple tasks is an important and challenging research topic in reinforcement learning and robotics. Training individual policies for every single potential task is often impractical, especially for…

Machine Learning · Statistics 2014-02-13 Marc Peter Deisenroth , Peter Englert , Jan Peters , Dieter Fox

The recent successes of deep learning and deep reinforcement learning have firmly established their statuses as state-of-the-art artificial learning techniques. However, longstanding drawbacks of these approaches, such as their poor sample…

Artificial Intelligence · Computer Science 2020-02-05 Thommen George Karimpanal

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution…

Machine Learning · Computer Science 2024-12-11 Yuli Slavutsky , Yuval Benjamini

One of the key reasons for the high sample complexity in reinforcement learning (RL) is the inability to transfer knowledge from one task to another. In standard multi-task RL settings, low-reward data collected while trying to solve one…

Machine Learning · Computer Science 2020-02-27 Alexander C. Li , Lerrel Pinto , Pieter Abbeel

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

In the zero-shot policy transfer setting in reinforcement learning, the goal is to train an agent on a fixed set of training environments so that it can generalise to similar, but unseen, testing environments. Previous work has shown that…

Machine Learning · Computer Science 2025-10-24 Max Weltevrede , Moritz A. Zanger , Matthijs T. J. Spaan , Wendelin Böhmer

Supervised learning (SL) and reinforcement learning (RL) are both widely used to train general-purpose agents for complex tasks, yet their generalization capabilities and underlying mechanisms are not yet fully understood. In this paper, we…

Machine Learning · Computer Science 2025-03-21 Meng Song

We consider problems of making sequences of decisions to accomplish tasks, interacting via the medium of language. These problems are often tackled with reinforcement learning approaches. We find that these models do not generalize well…

Computation and Language · Computer Science 2020-10-07 Xusen Yin , Ralph Weischedel , Jonathan May

Deep reinforcement learning (RL) has shown impressive results in a variety of domains, learning directly from high-dimensional sensory streams. However, when neural networks are trained in a fixed environment, such as a single level in a…

Machine Learning · Computer Science 2018-11-30 Niels Justesen , Ruben Rodriguez Torrado , Philip Bontrager , Ahmed Khalifa , Julian Togelius , Sebastian Risi