English
Related papers

Related papers: Understanding What Affects the Generalization Gap …

200 papers

Visual Reinforcement Learning (RL) agents trained on limited views face significant challenges in generalizing their learned abilities to unseen views. This inherent difficulty is known as the problem of $\textit{view generalization}$. In…

Machine Learning · Computer Science 2023-09-28 Sizhe Yang , Yanjie Ze , Huazhe Xu

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

As agentic systems increasingly rely on reinforcement learning from verifiable rewards, standardized ``gym'' infrastructure has become essential for rapid iteration, reproducibility, and fair comparison. Vision agents lack such…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Fanqing Meng , Lingxiao Du , Jiawei Gu , Jiaqi Liao , Linjie Li , Zijian Wu , Xiangyan Liu , Ziqi Zhao , Mengkang Hu , Zichen Liu , Jiaheng Zhang , Michael Qizhe Shieh

The generalization mystery in deep learning is the following: Why do over-parameterized neural networks trained with gradient descent (GD) generalize well on real datasets even though they are capable of fitting random datasets of…

Machine Learning · Computer Science 2022-06-07 Satrajit Chatterjee , Piotr Zielinski

Producing agents that can generalize to a wide range of visually different environments is a significant challenge in reinforcement learning. One method for overcoming this issue is visual domain randomization, whereby at the start of each…

Machine Learning · Computer Science 2020-03-09 Reda Bahi Slaoui , William R. Clements , Jakob N. Foerster , Sébastien Toth

Deep reinforcement learning policies, despite their outstanding efficiency in simulated visual control tasks, have shown disappointing ability to generalize across disturbances in the input training images. Changes in image statistics or…

Machine Learning · Computer Science 2023-02-09 David Bertoin , Adil Zouitine , Mehdi Zouitine , Emmanuel Rachelson

We study goal misgeneralization, a type of out-of-distribution generalization failure in reinforcement learning (RL). Goal misgeneralization failures occur when an RL agent retains its capabilities out-of-distribution yet pursues the wrong…

Machine Learning · Computer Science 2023-01-11 Lauro Langosco , Jack Koch , Lee Sharkey , Jacob Pfau , Laurent Orseau , David Krueger

Generalization in partially observed markov decision processes (POMDPs) is critical for successful applications of visual reinforcement learning (VRL) in real scenarios. A widely used idea is to learn task-relevant representations that…

Machine Learning · Computer Science 2023-02-21 Jie Wang , Rui Yang , Zijie Geng , Zhihao Shi , Mingxuan Ye , Qi Zhou , Shuiwang Ji , Bin Li , Yongdong Zhang , Feng Wu

Deep reinforcement learning algorithms that learn policies by trial-and-error must learn from limited amounts of data collected by actively interacting with the environment. While many prior works have shown that proper regularization…

Machine Learning · Computer Science 2023-04-21 Qiyang Li , Aviral Kumar , Ilya Kostrikov , Sergey Levine

The generalization ability of visuomotor policy is crucial, as a good policy should be deployable across diverse scenarios. Some methods can collect large amounts of trajectory augmentation data to train more generalizable imitation…

Robotics · Computer Science 2025-11-14 Hanwen Wang

Visual Reinforcement Learning (RL) methods often require extensive amounts of data. As opposed to model-free RL, model-based RL (MBRL) offers a potential solution with efficient data utilization through planning. Additionally, RL lacks…

Machine Learning · Computer Science 2025-01-16 Moritz Schneider , Robert Krug , Narunas Vaskevicius , Luigi Palmieri , Joschka Boedecker

Recent years have witnessed significant progresses in deep Reinforcement Learning (RL). Empowered with large scale neural networks, carefully designed architectures, novel training algorithms and massively parallel computing devices,…

Machine Learning · Computer Science 2018-04-23 Chiyuan Zhang , Oriol Vinyals , Remi Munos , Samy Bengio

Deep reinforcement learning (RL) has shown impressive results in a variety of domains, learning directly from high-dimensional sensory streams. However, when neural networks are trained in a fixed environment, such as a single level in a…

Machine Learning · Computer Science 2018-11-30 Niels Justesen , Ruben Rodriguez Torrado , Philip Bontrager , Ahmed Khalifa , Julian Togelius , Sebastian Risi

Imitation learning holds the promise of equipping robots with versatile skills by learning from expert demonstrations. However, policies trained on finite datasets often struggle to generalize beyond the training distribution. In this work,…

Machine Learning · Computer Science 2025-04-28 Yixiao Wang

We introduce a method to address goal misgeneralization in reinforcement learning (RL), leveraging Large Language Model (LLM) feedback during training. Goal misgeneralization, a type of robustness failure in RL occurs when an agent retains…

Machine Learning · Computer Science 2024-01-17 Houda Nait El Barj , Theophile Sautory

In the field of computer vision, data augmentation is widely used to enrich the feature complexity of training datasets with deep learning techniques. However, regarding the generalization capabilities of models, the difference in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Jianqiang Xiao , Weiwen Guo , Junfeng Liu , Mengze Li

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Reinforcement learning (RL) has achieved remarkable success in real-world decision-making across diverse domains, including gaming, robotics, online advertising, public health, and natural language processing. Despite these advances, a…

Applications · Statistics 2026-01-23 Asim H. Gazi , Yongyi Guo , Daiqi Gao , Ziping Xu , Kelly W. Zhang , Susan A. Murphy

Generalization across different environments with the same tasks is critical for successful applications of visual reinforcement learning (RL) in real scenarios. However, visual distractions -- which are common in real scenes -- from…

Machine Learning · Computer Science 2022-07-01 Rui Yang , Jie Wang , Zijie Geng , Mingxuan Ye , Shuiwang Ji , Bin Li , Feng Wu

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné