English
Related papers

Related papers: Improving Generalization in Visual Reinforcement L…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for Large Language Model (LLM) reasoning, yet current methods face key challenges in resource allocation and policy optimization dynamics: (i) uniform rollout…

Machine Learning · Computer Science 2026-04-24 Yangyi Fang , Jiaye Lin , Xiaoliang Fu , Cong Qin , Haolin Shi , Chaowen Hu , Lu Pan , Ke Zeng , Xunliang Cai

Data augmentation has proved extremely useful by increasing training data variance to alleviate overfitting and improve deep neural networks' generalization performance. In medical image analysis, a well-designed augmentation policy usually…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yunhe Gao , Zhiqiang Tang , Mu Zhou , Dimitris Metaxas

Meta-learning methods typically follow a two-loop framework, where each loop potentially suffers from notorious overfitting, hindering rapid adaptation and generalization to new tasks. Existing schemes solve it by enhancing the…

Machine Learning · Computer Science 2023-06-16 Ren Wang , Haoliang Sun , Qi Wei , Xiushan Nie , Yuling Ma , Yilong Yin

Gradient-based learning in multi-agent systems is difficult because the gradient derives from a first-order model which does not account for the interaction between agents' learning processes. LOLA (arXiv:1709.04326) accounts for this by…

Machine Learning · Computer Science 2023-12-12 Tim Cooijmans , Milad Aghajohari , Aaron Courville

Human beings can quickly adapt to environmental changes by leveraging learning experience. However, adapting deep neural networks to dynamic environments by machine learning algorithms remains a challenge. To better understand this issue,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Shixiang Tang , Peng Su , Dapeng Chen , Wanli Ouyang

Quantization-aware training (QAT) has achieved remarkable success in low-bit ($\leq$4-bit) quantization for classification networks. However, when applied to more complex visual tasks such as object detection and image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zhaoyang Wang , Dong Wang

Understanding an agent's goal through its behavior is a common AI problem called Goal Recognition (GR). This task becomes particularly challenging in dynamic environments where goals are numerous and ever-changing. We introduce the General…

Artificial Intelligence · Computer Science 2026-01-06 Osher Elhadad , Owen Morrissey , Reuth Mirsky

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Stochastic optimization plays a crucial role in the advancement of deep learning technologies. Over the decades, significant effort has been dedicated to improving the training efficiency and robustness of deep neural networks, via various…

Machine Learning · Computer Science 2024-08-21 Huixiu Jiang , Ling Yang , Yu Bao , Rutong Si , Sikun Yang

Deep reinforcement learning (RL) agents trained in a limited set of environments tend to suffer overfitting and fail to generalize to unseen testing environments. To improve their generalizability, data augmentation approaches (e.g. cutout…

Machine Learning · Computer Science 2020-10-22 Kaixin Wang , Bingyi Kang , Jie Shao , Jiashi Feng

In numerous reinforcement learning (RL) problems involving safety-critical systems, a key challenge lies in balancing multiple objectives while simultaneously meeting all stringent safety constraints. To tackle this issue, we propose a…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Alois Knoll , Ming Jin

One major obstacle that precludes the success of reinforcement learning in real-world applications is the lack of robustness, either to model uncertainties or external disturbances, of the trained policies. Robustness is critical when the…

Machine Learning · Computer Science 2020-05-05 Rahul Singh , Qinsheng Zhang , Yongxin Chen

Naive joint training of large language models (LLMs) for multilingual preference alignment can suffer from negative interference. This is a known issue in multilingual training, where conflicting objectives degrade overall performance.…

Computation and Language · Computer Science 2025-11-12 Jiangnan Li , Thuy-Trang Vu , Christian Herold , Amirhossein Tebbifakhr , Shahram Khadivi , Gholamreza Haffari

Generative adversarial imitation learning (GAIL) is a popular inverse reinforcement learning approach for jointly optimizing policy and reward from expert trajectories. A primary question about GAIL is whether applying a certain policy…

Machine Learning · Computer Science 2020-06-26 Ziwei Guan , Tengyu Xu , Yingbin Liang

ReParameterization (RP) Policy Gradient Methods (PGMs) have been widely adopted for continuous control tasks in robotics and computer graphics. However, recent studies have revealed that, when applied to long-term reinforcement learning…

Machine Learning · Computer Science 2023-11-01 Shenao Zhang , Boyi Liu , Zhaoran Wang , Tuo Zhao

Reasoning-based image quality assessment (IQA) models trained through reinforcement learning (RL) exhibit exceptional generalization, yet the underlying mechanisms and critical factors driving this capability remain underexplored in current…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Shijie Zhao , Xuanyu Zhang , Weiqi Li , Junlin Li , Li Zhang , Tianfan Xue , Jian Zhang

Policy gradient methods, which have been extensively studied in the last decade, offer an effective and efficient framework for reinforcement learning problems. However, their performances can often be unsatisfactory, suffering from…

Machine Learning · Computer Science 2026-01-27 Shihab Ahmed , El Houcine Bergou , Aritra Dutta , Yue Wang

Deep Reinforcement Learning has shown great success in a variety of control tasks. However, it is unclear how close we are to the vision of putting Deep RL into practice to solve real world problems. In particular, common practice in the…

Machine Learning · Computer Science 2019-02-21 Chenyang Zhao , Olivier Sigaud , Freek Stulp , Timothy M. Hospedales

Deep Reinforcement Learning (DRL) aims to create intelligent agents that can learn to solve complex problems efficiently in a real-world environment. Typically, two learning goals: adaptation and generalization are used for baselining DRL…

Machine Learning · Computer Science 2022-02-18 Pamul Yadav , Ashutosh Mishra , Junyong Lee , Shiho Kim

Reinforcement learning of real-world tasks is very data inefficient, and extensive simulation-based modelling has become the dominant approach for training systems. However, in human-robot interaction and many other real-world settings,…

Machine Learning · Computer Science 2023-09-12 Nat Wannawas , A. Aldo Faisal