English
Related papers

Related papers: Zero-shot Policy Learning with Spatial Temporal Re…

200 papers

The current dominant paradigm for imitation learning relies on strong supervision of expert actions to learn both 'what' and 'how' to imitate. We pursue an alternative paradigm wherein an agent first explores the world without any expert…

Zero-shot learning strives to classify unseen categories for which no data is available during training. In the generalized variant, the test samples can further belong to seen or unseen categories. The state-of-the-art relies on Generative…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Sanath Narayan , Akshita Gupta , Fahad Shahbaz Khan , Cees G. M. Snoek , Ling Shao

Zero-shot coordination (ZSC), the ability to adapt to a new partner in a cooperative task, is a critical component of human-compatible AI. While prior work has focused on training agents to cooperate on a single task, these specialized…

Multiagent Systems · Computer Science 2025-04-22 Kunal Jha , Wilka Carvalho , Yancheng Liang , Simon S. Du , Max Kleiman-Weiner , Natasha Jaques

Intelligent organisms can solve truly novel problems which they have never encountered before, either in their lifetime or their evolution. An important component of this capacity is the ability to ``think'', that is, to mentally manipulate…

Artificial Intelligence · Computer Science 2025-03-26 Thomas Miconi , Kevin McKee , Yicong Zheng , Jed McCaleb

Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to generalize across…

Machine Learning · Computer Science 2023-05-30 Boyuan Chen , Chuning Zhu , Pulkit Agrawal , Kaiqing Zhang , Abhishek Gupta

Zero-shot imitation learning algorithms hold the promise of reproducing unseen behavior from as little as a single demonstration at test time. Existing practical approaches view the expert demonstration as a sequence of goals, enabling…

Machine Learning · Computer Science 2025-06-13 Thomas Rupf , Marco Bagatella , Nico Gürtler , Jonas Frey , Georg Martius

In most real world scenarios, a policy trained by reinforcement learning in one environment needs to be deployed in another, potentially quite different environment. However, generalization across different environments is known to be hard.…

Machine Learning · Computer Science 2021-04-12 Nicklas Hansen , Rishabh Jangir , Yu Sun , Guillem Alenyà , Pieter Abbeel , Alexei A. Efros , Lerrel Pinto , Xiaolong Wang

Deep reinforcement learning (RL) can acquire complex behaviors from low-level inputs, such as images. However, real-world applications of such methods require generalizing to the vast variability of the real world. Deep networks are known…

Machine Learning · Computer Science 2017-03-13 Chelsea Finn , Tianhe Yu , Justin Fu , Pieter Abbeel , Sergey Levine

The reward hypothesis states that all goals and purposes can be understood as the maximization of a received scalar reward signal. However, in practice, defining such a reward signal is notoriously difficult, as humans are often unable to…

Artificial Intelligence · Computer Science 2025-11-26 Harshit Sikchi , Siddhant Agarwal , Pranaya Jajoo , Samyak Parajuli , Caleb Chuck , Max Rudolph , Peter Stone , Amy Zhang , Scott Niekum

Generalized zero-shot learning recognizes inputs from both seen and unseen classes. Yet, existing methods tend to be biased towards the classes seen during training. In this paper, we strive to mitigate this bias. We propose a bias-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 William Thong , Cees G. M. Snoek

Despite recent breakthroughs in reinforcement learning (RL) and imitation learning (IL), existing algorithms fail to generalize beyond the training environments. In reality, humans can adapt to new tasks quickly by leveraging prior…

Machine Learning · Computer Science 2023-04-18 Tianshi Cao , Jingkang Wang , Yining Zhang , Sivabalan Manivasagam

We present a novel problem setting in zero-shot learning, zero-shot object recognition and detection in the context. Contrary to the traditional zero-shot learning methods, which simply infers unseen categories by transferring knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Ruotian Luo , Ning Zhang , Bohyung Han , Linjie Yang

In this work we present a method for leveraging data from one source to learn how to do multiple new tasks. Task transfer is achieved using a self-model that encapsulates the dynamics of a system and serves as an environment for…

Robotics · Computer Science 2019-10-07 Robert Kwiatkowski , Hod Lipson

To overcome the absence of training data for unseen classes, conventional zero-shot learning approaches mainly train their model on seen datapoints and leverage the semantic descriptions for both seen and unseen classes. Beyond exploiting…

Machine Learning · Computer Science 2019-10-22 Hyeonwoo Yu , Beomhee Lee

While various multi-agent reinforcement learning methods have been proposed in cooperative settings, few works investigate how self-interested learning agents achieve mutual coordination in decentralized general-sum games and generalize…

Multiagent Systems · Computer Science 2023-01-05 Ziyi Liu , Xian Guo , Yongchun Fang

Simulation based learning often provides a cost-efficient recourse to reinforcement learning applications in robotics. However, simulators are generally incapable of accurately replicating real-world dynamics, and thus bridging the sim2real…

Machine Learning · Computer Science 2023-02-09 Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana , Svetha Venkatesh

Learning policies which are robust to changes in the environment are critical for real world deployment of Reinforcement Learning agents. They are also necessary for achieving good generalization across environment shifts. We focus on…

Machine Learning · Computer Science 2023-06-08 Anuj Mahajan , Amy Zhang

There is a recent trend of applying multi-agent reinforcement learning (MARL) to train an agent that can cooperate with humans in a zero-shot fashion without using any human data. The typical workflow is to first repeatedly run self-play…

Artificial Intelligence · Computer Science 2023-02-06 Chao Yu , Jiaxuan Gao , Weilin Liu , Botian Xu , Hao Tang , Jiaqi Yang , Yu Wang , Yi Wu

In this work we create agents that can perform well beyond a single, individual task, that exhibit much wider generalisation of behaviour to a massive, rich space of challenges. We define a universe of tasks within an environment domain and…

Many real-world robot learning problems, such as pick-and-place or arriving at a destination, can be seen as a problem of reaching a goal state as soon as possible. These problems, when formulated as episodic reinforcement learning tasks,…

Robotics · Computer Science 2024-07-10 Gautham Vasan , Yan Wang , Fahim Shahriar , James Bergstra , Martin Jagersand , A. Rupam Mahmood