中文
相关论文

相关论文: Normalization Enhances Generalization in Visual Re…

200 篇论文

Deep reinforcement learning (RL) has shown impressive results in a variety of domains, learning directly from high-dimensional sensory streams. However, when neural networks are trained in a fixed environment, such as a single level in a…

Reinforcement learning (RL) methods with a high replay ratio (RR) and regularization have gained interest due to their superior sample efficiency. However, these methods have mainly been developed for dense-reward tasks. In this paper, we…

机器学习 · 计算机科学 2023-12-12 Takuya Hiraoka

Reasoning from diverse observations is a fundamental capability for generalist robot policies to operate in a wide range of environments. Despite recent advancements, many large-scale robotic policies still remain sensitive to key sources…

机器人学 · 计算机科学 2025-12-08 Jonathan Yang , Chelsea Finn , Dorsa Sadigh

Accurate chart comprehension represents a critical challenge in advancing multimodal learning systems, as extensive information is compressed into structured visual representations. However, existing vision-language models (VLMs) frequently…

机器学习 · 计算机科学 2026-03-10 Xin Zhang , Xingyu Li , Rongguang Wang , Ruizhong Miao , Zheng Wang , Dan Roth , Chenyang Li

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

机器学习 · 计算机科学 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-data challenges and…

机器学习 · 计算机科学 2023-06-09 Tianyu Shi , Francois-Xavier Devailly , Denis Larocque , Laurent Charlin

Generalization is a central challenge for the deployment of reinforcement learning (RL) systems in the real world. In this paper, we show that the sequential structure of the RL problem necessitates new approaches to generalization beyond…

机器学习 · 计算机科学 2021-07-14 Dibya Ghosh , Jad Rahme , Aviral Kumar , Amy Zhang , Ryan P. Adams , Sergey Levine

The successful training of deep neural networks requires addressing challenges such as overfitting, numerical instabilities leading to divergence, and increasing variance in the residual stream. A common solution is to apply regularization…

Offline reinforcement learning has shown great promise in leveraging large pre-collected datasets for policy learning, allowing agents to forgo often-expensive online data collection. However, offline reinforcement learning from visual…

机器学习 · 计算机科学 2023-07-07 Cong Lu , Philip J. Ball , Tim G. J. Rudner , Jack Parker-Holder , Michael A. Osborne , Yee Whye Teh

Generalization remains a core challenge in embodied AI, as robots must adapt to diverse environments. While OpenVLA represents the State-of-the-Art (SOTA) in Vision-Language-Action models by leveraging large-scale pre-training, its…

人工智能 · 计算机科学 2026-03-18 Dongik Shin

Learning generalizable policies that can adapt to unseen environments remains challenging in visual Reinforcement Learning (RL). Existing approaches try to acquire a robust representation via diversifying the appearances of in-domain…

机器学习 · 计算机科学 2022-12-20 Zhecheng Yuan , Zhengrong Xue , Bo Yuan , Xueqian Wang , Yi Wu , Yang Gao , Huazhe Xu

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated…

机器学习 · 计算机科学 2023-07-12 Hui Kang , Sheng Liu , Huaxi Huang , Jun Yu , Bo Han , Dadong Wang , Tongliang Liu

In this paper, we investigate the problem of overfitting in deep reinforcement learning. Among the most common benchmarks in RL, it is customary to use the same environments for both training and testing. This practice offers relatively…

机器学习 · 计算机科学 2019-07-16 Karl Cobbe , Oleg Klimov , Chris Hesse , Taehoon Kim , John Schulman

In recent years, supervised approaches using deep neural networks (DNNs) have become the mainstream for speech enhancement. It has been established that DNNs generalize well to untrained noises and speakers if trained using a large number…

声音 · 计算机科学 2020-08-11 Ashutosh Pandey , DeLiang Wang

Normalization techniques have become a basic component in modern convolutional neural networks (ConvNets). In particular, many recent works demonstrate that promoting the orthogonality of the weights helps train deep models and improve…

计算机视觉与模式识别 · 计算机科学 2022-01-05 Sheng Liu , Xiao Li , Yuexiang Zhai , Chong You , Zhihui Zhu , Carlos Fernandez-Granda , Qing Qu

While several benefits were realized for multilingual vision-language pretrained models, recent benchmarks across various tasks and languages showed poor cross-lingual generalisation when multilingually pre-trained vision-language models…

计算与语言 · 计算机科学 2022-12-01 Farhad Nooralahzadeh , Rico Sennrich

While recent model-free Reinforcement Learning (RL) methods have demonstrated human-level effectiveness in gaming environments, their success in everyday tasks like visual navigation has been limited, particularly under significant…

机器学习 · 计算机科学 2024-04-04 Rudra P. K. Poudel , Harit Pandya , Stephan Liwicki , Roberto Cipolla

Vision Language Models (VLMs) are designed to extend Large Language Models (LLMs) with visual capabilities, yet in this work we observe a surprising phenomenon: VLMs can outperform their underlying LLMs on purely text-only tasks,…

机器学习 · 计算机科学 2026-02-18 Nicolas Buzeta , Felipe del Rio , Cristian Hinostroza , Denis Parra , Hans Lobel , Rodrigo Toro Icarte

Reinforcement Learning has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet the resulting policies remain brittle against real-world visual degradations such as blur, compression artifacts,…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Rui Liu , Dian Yu , Haolin Liu , Yucheng Shi , Tong Zheng , Runpeng Dai , Haitao Mi , Pratap Tokekar , Leoweiliang

Reinforcement learning (RL) is increasingly used to post-train medical Vision-Language Models (VLMs), yet it remains unclear whether RL improves medical visual reasoning or mainly sharpens behaviors already induced by supervised fine-tuning…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Ahmadreza Jeddi , Kimia Shaban , Negin Baghbanzadeh , Natasha Sharan , Abhishek Moturu , Elham Dolatabadi , Babak Taati