English
Related papers

Related papers: Inferring Behavior-Specific Context Improves Zero-…

200 papers

Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training.…

Machine Learning · Computer Science 2024-06-17 Samuel Garcin , James Doran , Shangmin Guo , Christopher G. Lucas , Stefano V. Albrecht

Recent work has shown that, under certain assumptions, zero-shot reinforcement learning (RL) methods can generalise to any unseen task in an environment after reward-free pre-training. Access to Markov states is one such assumption, yet, in…

Machine Learning · Computer Science 2025-06-19 Scott Jeen , Tom Bewley , Jonathan M. Cullen

This paper considers the problem of learning a control policy for robot motion planning with zero-shot generalization, i.e., no data collection and policy adaptation is needed when the learned policy is deployed in new environments. We…

Systems and Control · Electrical Eng. & Systems 2024-04-09 Zhenyuan Yuan , Siyuan Xu , Minghui Zhu

In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect…

Robotics · Computer Science 2024-03-01 Adam Sigal , Hsiu-Chin Lin , AJung Moon

In this paper, hypernetworks are trained to generate behaviors across a range of unseen task conditions, via a novel TD-based training objective and data from a set of near-optimal RL solutions for training tasks. This work relates to meta…

Machine Learning · Computer Science 2023-01-04 Sahand Rezaei-Shoshtari , Charlotte Morissette , Francois Robert Hogan , Gregory Dudek , David Meger

Zero-shot learning (ZSL) aims at recognizing classes for which no visual sample is available at training time. To address this issue, one can rely on a semantic description of each class. A typical ZSL model learns a mapping between the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Celina Hanouti , Hervé Le Borgne

In this work we present a method for leveraging data from one source to learn how to do multiple new tasks. Task transfer is achieved using a self-model that encapsulates the dynamics of a system and serves as an environment for…

Robotics · Computer Science 2019-10-07 Robert Kwiatkowski , Hod Lipson

Episodic training, where an agent's environment is reset after every success or failure, is the de facto standard when training embodied reinforcement learning (RL) agents. The underlying assumption that the environment can be easily reset…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Zichen Zhang , Luca Weihs

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

Though deep reinforcement learning agents have achieved unprecedented success in recent years, their learned policies can be brittle, failing to generalize to even slight modifications of their environments or unfamiliar situations. The…

Artificial Intelligence · Computer Science 2021-12-13 Yiheng Xie , Mingxuan Li , Shangqun Yu , Michael Littman

This work introduces a neuro-symbolic agent that combines deep reinforcement learning (DRL) with temporal logic (TL) to achieve systematic zero-shot, i.e., never-seen-before, generalisation of formally specified instructions. In particular,…

Machine Learning · Computer Science 2021-09-14 Borja G. León , Murray Shanahan , Francesco Belardinelli

While reinforcement learning provides an appealing formalism for learning individual skills, a general-purpose robotic system must be able to master an extensive repertoire of behaviors. Instead of learning a large collection of skills…

Robotics · Computer Science 2019-10-28 Ashvin Nair , Shikhar Bahl , Alexander Khazatsky , Vitchyr Pong , Glen Berseth , Sergey Levine

In this paper, we confront the problem of applying reinforcement learning to agents that perceive the environment through many sensors and that can perform parallel actions using many actuators as is the case in complex autonomous robots.…

Artificial Intelligence · Computer Science 2011-07-04 E. Celaya , J. M. Porta

Supervised learning (SL) and reinforcement learning (RL) are both widely used to train general-purpose agents for complex tasks, yet their generalization capabilities and underlying mechanisms are not yet fully understood. In this paper, we…

Machine Learning · Computer Science 2025-03-21 Meng Song

Recent progress towards learning from limited supervision has encouraged efforts towards designing models that can recognize novel classes at test time (generalized zero-shot learning or GZSL). GZSL approaches assume knowledge of all…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Hari Chandana Kuchibhotla , Sumitra S Malagi , Shivam Chandhok , Vineeth N Balasubramanian

Zero-shot learning (ZSL) which aims to recognize unseen object classes by only training on seen object classes, has increasingly been of great interest in Machine Learning, and has registered with some successes. Most existing ZSL methods…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Wen Tang , Ashkan Panahi , Hamid Krim

Agents trained by reinforcement learning (RL) often fail to generalize beyond the environment they were trained in, even when presented with new scenarios that seem similar to the training environment. We study the query complexity required…

Machine Learning · Computer Science 2021-10-27 Dhruv Malik , Yuanzhi Li , Pradeep Ravikumar

Children can rapidly generalize compositionally-constructed rules to unseen test sets. On the other hand, deep reinforcement learning (RL) agents need to be trained over millions of episodes, and their ability to generalize to unseen…

Machine Learning · Computer Science 2024-05-06 Zijun Lin , Haidi Azaman , M Ganesh Kumar , Cheston Tan

The reward hypothesis states that all goals and purposes can be understood as the maximization of a received scalar reward signal. However, in practice, defining such a reward signal is notoriously difficult, as humans are often unable to…

Artificial Intelligence · Computer Science 2025-11-26 Harshit Sikchi , Siddhant Agarwal , Pranaya Jajoo , Samyak Parajuli , Caleb Chuck , Max Rudolph , Peter Stone , Amy Zhang , Scott Niekum

We introduce a new RL problem where the agent is required to generalize to a previously-unseen environment characterized by a subtask graph which describes a set of subtasks and their dependencies. Unlike existing hierarchical multitask RL…

Machine Learning · Computer Science 2019-05-28 Sungryull Sohn , Junhyuk Oh , Honglak Lee