中文
相关论文

相关论文: Understanding What Affects the Generalization Gap …

200 篇论文

The adaptation of large-scale Vision-Language Models (VLMs) through post-training reveals a pronounced generalization gap: models fine-tuned with Reinforcement Learning (RL) consistently achieve superior out-of-distribution (OOD)…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Aojun Lu , Tao Feng , Hangjie Yuan , Wei Li , Yanan Sun

We propose a general formulation for addressing reinforcement learning (RL) problems in settings with observational data. That is, we consider the problem of learning good policies solely from historical data in which unobserved factors…

机器学习 · 计算机科学 2018-12-31 Chaochao Lu , Bernhard Schölkopf , José Miguel Hernández-Lobato

Text-based games (TBGs) have become a popular proving ground for the demonstration of learning-based agents that make decisions in quasi real-world settings. The crux of the problem for a reinforcement learning agent in such TBGs is…

机器学习 · 计算机科学 2021-06-16 Keerthiram Murugesan , Subhajit Chaudhury , Kartik Talamadupula

Deep reinforcement learning (RL) agents often fail to generalize to unseen environments (yet semantically similar to trained agents), particularly when they are trained on high-dimensional state spaces, such as images. In this paper, we…

机器学习 · 计算机科学 2020-02-18 Kimin Lee , Kibok Lee , Jinwoo Shin , Honglak Lee

A primary challenge for visual-based Reinforcement Learning (RL) is to generalize effectively across unseen environments. Although previous studies have explored different auxiliary tasks to enhance generalization, few adopt image…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Di Zhang , Bowen Lv , Hai Zhang , Feifan Yang , Junqiao Zhao , Hang Yu , Chang Huang , Hongtu Zhou , Chen Ye , Changjun Jiang

Building generalist agents that can accomplish many goals in rich open-ended environments is one of the research frontiers for reinforcement learning. A key limiting factor for building generalist agents with RL has been the need for a…

We study the problem of distributed multi-view representation learning. In this problem, $K$ agents observe each one distinct, possibly statistically correlated, view and independently extracts from it a suitable representation in a manner…

机器学习 · 统计学 2025-04-28 Milad Sefidgaran , Abdellatif Zaidi , Piotr Krasnowski

Modern RAN operate in highly dynamic and heterogeneous environments, where hand-tuned, rule-based RRM algorithms often underperform. While RL can surpass such heuristics in constrained settings, the diversity of deployments and…

机器学习 · 计算机科学 2026-01-29 Burak Demirel , Yu Wang , Cristian Tatino , Pablo Soldati

Despite the widespread adoption of multi-task training in deep learning, little is understood about how multi-task learning (MTL) affects generalization. Prior work has conjectured that the negative effects of MTL are due to optimization…

机器学习 · 计算机科学 2025-01-31 David Mueller , Mark Dredze , Nicholas Andrews

While adversarial training methods have significantly improved the robustness of deep neural networks against norm-bounded adversarial perturbations, the generalization gap between their performance on training and test data is considerably…

机器学习 · 计算机科学 2025-01-08 Xiwei Cheng , Kexin Fu , Farzan Farnia

Reinforcement learning (RL) is a dominant paradigm for training autonomous agents, yet these agents often exhibit poor generalization, failing to adapt to scenarios not seen during training. In this work, we identify a fundamental cause of…

人工智能 · 计算机科学 2026-01-16 Jingyu Liu , Xiaopeng Wu , Jingquan Peng , Kehan Chen , Chuan Yu , Lizhong Ding , Yong Liu

Meta reinforcement learning (RL) attempts to discover new RL algorithms automatically from environment interaction. In so-called black-box approaches, the policy and the learning algorithm are jointly represented by a single neural network.…

机器学习 · 计算机科学 2022-06-07 Louis Kirsch , Sebastian Flennerhag , Hado van Hasselt , Abram Friesen , Junhyuk Oh , Yutian Chen

Recently, various pre-training methods have been introduced in vision-based Reinforcement Learning (RL). However, their generalization ability remains unclear due to evaluations being limited to in-distribution environments and non-unified…

机器学习 · 计算机科学 2024-06-11 Donghu Kim , Hojoon Lee , Kyungmin Lee , Dongyoon Hwang , Jaegul Choo

Understanding and accurately following instructions is critical for large language models (LLMs) to be effective across diverse tasks. In this work, we rigorously examine the key factors that enable models to generalize to unseen…

计算与语言 · 计算机科学 2024-10-21 Dylan Zhang , Justin Wang , Francois Charton

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

机器学习 · 计算机科学 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Learning agile humanoid behaviors from human motion offers a powerful route to natural, coordinated control, but existing approaches face a persistent trade-off: reference-tracking policies are often brittle outside the demonstration…

机器人学 · 计算机科学 2026-02-25 Jiashun Wang , M. Eva Mungai , He Li , Jean Pierre Sleiman , Jessica Hodgins , Farbod Farshidian

A key approach to state abstraction is approximating behavioral metrics (notably, bisimulation metrics) in the observation space and embedding these learned distances in the representation space. While promising for robustness to…

机器学习 · 计算机科学 2025-09-10 Ziyan Luo , Tianwei Ni , Pierre-Luc Bacon , Doina Precup , Xujie Si

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a key method for improving Large Language Models' reasoning capabilities, yet recent evidence suggests it may paradoxically shrink the reasoning boundary rather than…

人工智能 · 计算机科学 2025-10-03 Phuc Minh Nguyen , Chinh D. La , Duy M. H. Nguyen , Nitesh V. Chawla , Binh T. Nguyen , Khoa D. Doan

While Reinforcement Learning (RL) has achieved remarkable success in language modeling, its triumph hasn't yet fully translated to visuomotor agents. A primary challenge in RL models is their tendency to overfit specific tasks or…

机器人学 · 计算机科学 2025-08-01 Shaofei Cai , Zhancun Mu , Haiwen Xia , Bowei Zhang , Anji Liu , Yitao Liang

In visuomotor policy learning, the control policy for the robotic agent is derived directly from visual inputs. The typical approach, where a policy and vision encoder are trained jointly from scratch, generalizes poorly to novel visual…

机器人学 · 计算机科学 2025-09-17 Scott Jones , Liyou Zhou , Sebastian W. Pattinson