English
Related papers

Related papers: How the level sampling process impacts zero-shot g…

200 papers

Standard supervised learning setting assumes that training data and test data come from the same distribution (domain). Domain generalization (DG) methods try to learn a model that when trained on data from multiple domains, would…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Udit Maniyar , Joseph K J , Aniket Anand Deshmukh , Urun Dogan , Vineeth N Balasubramanian

Deep Reinforcement Learning (RL) methods rely on experience replay to approximate the minibatched supervised learning setting; however, unlike supervised learning where access to lots of training data is crucial to generalization,…

Machine Learning · Computer Science 2021-02-24 Brett Daley , Cameron Hickert , Christopher Amato

Training general agents to follow complex instructions (tasks) in intricate environments (levels) remains a core challenge in reinforcement learning. Random sampling of task-level pairs often produces unsolvable combinations, highlighting…

Machine Learning · Computer Science 2025-12-30 Daniel Furelos-Blanco , Charles Pert , Frederik Kelbel , Alex F. Spies , Alessandra Russo , Michael Dennis

Before deploying autonomous agents in the real world, we need to be confident they will perform safely in novel situations. Ideally, we would expose agents to a very wide range of situations during training, allowing them to learn about…

Machine Learning · Computer Science 2019-07-03 Zachary Kenton , Angelos Filos , Owain Evans , Yarin Gal

Unsupervised Environment Design (UED) seeks to automatically generate training curricula for reinforcement learning (RL) agents, with the goal of improving generalisation and zero-shot performance. However, designing effective curricula…

Machine Learning · Computer Science 2026-01-22 Harry Mead , Bruno Lacerda , Jakob Foerster , Nick Hawes

Deep Reinforcement Learning (RL) models often fail to generalize when even small changes occur in the environment's observations or task requirements. Addressing these shifts typically requires costly retraining, limiting the reusability of…

Machine Learning · Computer Science 2025-03-05 Antonio Pio Ricciardi , Valentino Maiorca , Luca Moschella , Riccardo Marin , Emanuele Rodolà

Training agents that are robust to environmental changes remains a significant challenge in deep reinforcement learning (RL). Unsupervised environment design (UED) has recently emerged to address this issue by generating a set of training…

Machine Learning · Computer Science 2024-11-18 Hojun Chung , Junseo Lee , Minsoo Kim , Dohyeong Kim , Songhwai Oh

The performance of generative zero-shot methods mainly depends on the quality of generated features and how well the model facilitates knowledge transfer between visual and semantic domains. The quality of generated features is a direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Shivam Chandhok , Vineeth N Balasubramanian

Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and…

Machine Learning · Computer Science 2019-01-23 Shaeke Salman , Xiuwen Liu

Deep reinforcement learning (RL) agents often fail to generalize to unseen environments (yet semantically similar to trained agents), particularly when they are trained on high-dimensional state spaces, such as images. In this paper, we…

Machine Learning · Computer Science 2020-02-18 Kimin Lee , Kibok Lee , Jinwoo Shin , Honglak Lee

A dominant approach for addressing unsupervised domain adaptation is to map data points for the source and the target domains into an embedding space which is modeled as the output-space of a shared deep encoder. The encoder is trained to…

Machine Learning · Computer Science 2022-09-30 Mohammad Rostami

It is common practice in deep learning to use overparameterized networks and train for as long as possible; there are numerous studies that show, both theoretically and empirically, that such practices surprisingly do not unduly harm the…

Machine Learning · Computer Science 2020-03-05 Leslie Rice , Eric Wong , J. Zico Kolter

Modern reinforcement learning (RL) systems capture deep truths about general, human problem-solving. In domains where new data can be simulated cheaply, these systems uncover sequential decision-making policies that far exceed the ability…

Machine Learning · Computer Science 2025-10-07 Scott Jeen

Unsupervised person re-identification (re-ID) remains a challenging task. While extensive research has focused on the framework design and loss function, this paper shows that sampling strategy plays an equally important role. We analyze…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Xumeng Han , Xuehui Yu , Guorong Li , Jian Zhao , Gang Pan , Qixiang Ye , Jianbin Jiao , Zhenjun Han

We study zero-shot generalization in reinforcement learning-optimizing a policy on a set of training tasks to perform well on a similar but unseen test task. To mitigate overfitting, previous work explored different notions of invariance to…

Machine Learning · Computer Science 2024-01-17 Ev Zisselman , Itai Lavie , Daniel Soudry , Aviv Tamar

The past decade has seen vast progress in deep reinforcement learning (RL) on the back of algorithms manually designed by human researchers. Recently, it has been shown that it is possible to meta-learn update rules, with the hope of…

Unsupervised domain adaptation aims to transfer knowledge from a source domain to a target domain so that the target domain data can be recognized without any explicit labelling information for this domain. One limitation of the problem…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Qian Wang , Penghui Bu , Toby P. Breckon

Recent years have witnessed significant progresses in deep Reinforcement Learning (RL). Empowered with large scale neural networks, carefully designed architectures, novel training algorithms and massively parallel computing devices,…

Machine Learning · Computer Science 2018-04-23 Chiyuan Zhang , Oriol Vinyals , Remi Munos , Samy Bengio

Deep learning-based online mapping has emerged as a cornerstone of autonomous driving, yet these models frequently fail to generalize beyond familiar environments. We propose a framework to identify and measure the underlying failure modes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Michael Hubbertz , Qi Han , Tobias Meisen

Distributed learning is essential to train machine learning algorithms across heterogeneous agents while maintaining data privacy. We conduct an asymptotic analysis of Unified Distributed SGD (UD-SGD), exploring a variety of communication…

Machine Learning · Computer Science 2024-10-30 Jie Hu , Yi-Ting Ma , Do Young Eun