English
Related papers

Related papers: A Survey of Zero-shot Generalisation in Deep Reinf…

200 papers

Many recent advances in computer vision are the result of a healthy competition among researchers on high quality, task-specific, benchmarks. After a decade of active research, zero-shot learning (ZSL) models accuracy on the Imagenet…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Tristan Hascoet , Yasuo Ariki , Tetsuya Takiguchi

Methods proposed in the literature for zero-shot learning (ZSL) are typically suitable for offline learning and cannot continually learn from sequential streaming data. The sequential data comes in the form of tasks during training.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

Reinforcement Learning (RL) has demonstrated remarkable success in solving sequential decision-making problems. However, in real-world scenarios, RL agents often struggle to generalize when faced with unseen actions that were not…

Machine Learning · Computer Science 2025-03-13 Abdullah Alchihabi , Hanping Zhang , Yuhong Guo

We study zero-shot generalization in reinforcement learning-optimizing a policy on a set of training tasks to perform well on a similar but unseen test task. To mitigate overfitting, previous work explored different notions of invariance to…

Machine Learning · Computer Science 2024-01-17 Ev Zisselman , Itai Lavie , Daniel Soudry , Aviv Tamar

In this paper, hypernetworks are trained to generate behaviors across a range of unseen task conditions, via a novel TD-based training objective and data from a set of near-optimal RL solutions for training tasks. This work relates to meta…

Machine Learning · Computer Science 2023-01-04 Sahand Rezaei-Shoshtari , Charlotte Morissette , Francois Robert Hogan , Gregory Dudek , David Meger

Model-based reinforcement learning (MBRL) has been used to efficiently solve vision-based control tasks in highdimensional image observations. Although recent MBRL algorithms perform well in trained observations, they fail when faced with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Jeongsoo Ha , Kyungsoo Kim , Yusung Kim

Zero-Shot Learning (ZSL) is an emerging research that aims to solve the classification problems with very few training data. The present works on ZSL mainly focus on the mapping of learning semantic space to visual space. It encounters many…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Zeng Ting , Xiang Hongxin , Xie Cheng , Yang Yun , Liu Qing

Zero-shot learning (ZSL) which aims to recognize unseen object classes by only training on seen object classes, has increasingly been of great interest in Machine Learning, and has registered with some successes. Most existing ZSL methods…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Wen Tang , Ashkan Panahi , Hamid Krim

Graphical user interface (GUI)-based mobile agents automate digital tasks on mobile devices by interpreting natural-language instructions and interacting with the screen. While recent methods apply reinforcement learning (RL) to train…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Li Gu , Zihuan Jiang , Zhixiang Chi , Huan Liu , Ziqiang Wang , Yuanhao Yu , Glen Berseth , Yang Wang

Zero-shot generalization (ZSG) to unseen dynamics is a major challenge for creating generally capable embodied agents. To address the broader challenge, we start with the simpler setting of contextual reinforcement learning (cRL), assuming…

Machine Learning · Computer Science 2024-08-06 Sai Prasanna , Karim Farid , Raghu Rajan , André Biedenkapp

Zero-shot learning is a learning regime that recognizes unseen classes by generalizing the visual-semantic relationship learned from the seen classes. To obtain an effective ZSL model, one may resort to curating training samples from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zhi Chen , Yadan Luo , Sen Wang , Jingjing Li , Zi Huang

Zero-shot learning (ZSL) can be defined by correctly solving a task where no training data is available, based on previous acquired knowledge from different, but related tasks. So far, this area has mostly drawn the attention from computer…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Joao Reis , Gil Gonçalves

Deep learning models have the ability to extract rich knowledge from large-scale datasets. However, the sharing of data has become increasingly challenging due to concerns regarding data copyright and privacy. Consequently, this hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Bowen Tang , Long Yan , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Zero-shot learning deals with the ability to recognize objects without any visual training sample. To counterbalance this lack of visual data, each class to recognize is associated with a semantic prototype that reflects the essential…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

With the recent renaissance of deep convolution neural networks, encouraging breakthroughs have been achieved on the supervised recognition tasks, where each class has sufficient training data and fully annotated training data. However, to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-16 Yanwei Fu , Tao Xiang , Yu-Gang Jiang , Xiangyang Xue , Leonid Sigal , Shaogang Gong

Zero-Shot Learning (ZSL) aims to recognize unseen classes by generalizing the knowledge, i.e., visual and semantic relationships, obtained from seen classes, where image augmentation techniques are commonly applied to improve the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Zhi Chen , Pengfei Zhang , Jingjing Li , Sen Wang , Zi Huang

Reinforcement learning (RL) promises a framework for near-universal problem-solving. In practice however, RL algorithms are often tailored to specific benchmarks, relying on carefully tuned hyperparameters and algorithmic choices. Recently,…

Machine Learning · Computer Science 2025-01-28 Scott Fujimoto , Pierluca D'Oro , Amy Zhang , Yuandong Tian , Michael Rabbat

Deep Reinforcement Learning (RL) models often fail to generalize when even small changes occur in the environment's observations or task requirements. Addressing these shifts typically requires costly retraining, limiting the reusability of…

Machine Learning · Computer Science 2025-03-05 Antonio Pio Ricciardi , Valentino Maiorca , Luca Moschella , Riccardo Marin , Emanuele Rodolà

A zero-shot RL agent is an agent that can solve any RL task in a given environment, instantly with no additional planning or learning, after an initial reward-free learning phase. This marks a shift from the reward-centric RL paradigm…

Machine Learning · Computer Science 2023-03-02 Ahmed Touati , Jérémy Rapin , Yann Ollivier

While Reinforcement Learning (RL) has achieved remarkable success in language modeling, its triumph hasn't yet fully translated to visuomotor agents. A primary challenge in RL models is their tendency to overfit specific tasks or…

Robotics · Computer Science 2025-08-01 Shaofei Cai , Zhancun Mu , Haiwen Xia , Bowei Zhang , Anji Liu , Yitao Liang