English
Related papers

Related papers: Improving Generalization in Visual Reinforcement L…

200 papers

Reinforcement learning with general utilities (RLGU) offers a unifying framework to capture several problems beyond standard expected returns, including imitation learning, pure exploration, and safe RL. Despite recent fundamental advances…

Machine Learning · Computer Science 2025-10-27 Anas Barakat , Souradip Chakraborty , Peihong Yu , Pratap Tokekar , Amrit Singh Bedi

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

Machine Learning · Computer Science 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Reinforcement learning (RL) agents can learn to solve complex tasks from visual inputs, but generalizing these learned skills to new environments remains a major challenge in RL application, especially robotics. While data augmentation can…

Robotics · Computer Science 2025-09-08 Tien Pham , Xinyun Chi , Khang Nguyen , Manfred Huber , Angelo Cangelosi

Research on loss surface geometry, such as Sharpness-Aware Minimization (SAM), shows that flatter minima improve generalization. Recent studies further reveal that flatter minima can also reduce the domain generalization (DG) gap. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jiacheng Jiang , Yuan Meng , Chen Tang , Han Yu , Qun Li , Zhi Wang , Wenwu Zhu

In today's rapidly evolving military landscape, advancing artificial intelligence (AI) in support of wargaming becomes essential. Despite reinforcement learning (RL) showing promise for developing intelligent agents, conventional RL faces…

Machine Learning · Computer Science 2024-08-27 Scotty Black

Imitation learning has emerged as a crucial ap proach for acquiring visuomotor skills from demonstrations, where designing effective observation encoders is essential for policy generalization. However, existing methods often struggle to…

Robotics · Computer Science 2025-12-01 Yikai Tang , Haoran Geng , Sheng Zang , Pieter Abbeel , Jitendra Malik

Extensive efforts have been made to improve the generalization ability of Reinforcement Learning (RL) methods via domain randomization and data augmentation. However, as more factors of variation are introduced during training, optimization…

Machine Learning · Computer Science 2021-04-12 Nicklas Hansen , Xiaolong Wang

Learning a policy capable of moving an agent between any two states in the environment is important for many robotics problems involving navigation and manipulation. Due to the sparsity of rewards in such tasks, applying reinforcement…

Artificial Intelligence · Computer Science 2018-07-05 Artem Molchanov , Karol Hausman , Stan Birchfield , Gaurav Sukhatme

Deep neural networks are vulnerable to universal adversarial perturbation (UAP), an instance-agnostic perturbation capable of fooling the target model for most samples. Compared to instance-specific adversarial examples, UAP is more…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Xuannan Liu , Yaoyao Zhong , Yuhang Zhang , Lixiong Qin , Weihong Deng

Producing agents that can generalize to a wide range of visually different environments is a significant challenge in reinforcement learning. One method for overcoming this issue is visual domain randomization, whereby at the start of each…

Machine Learning · Computer Science 2020-03-09 Reda Bahi Slaoui , William R. Clements , Jakob N. Foerster , Sébastien Toth

Reinforcement Learning (RL) for training Large Language Models is notoriously unstable. While recent studies attribute this to "training inference mismatch stemming" from inconsistent hybrid engines, standard remedies, such as Importance…

Machine Learning · Computer Science 2026-02-03 Yaxiang Zhang , Yingru Li , Jiacai Liu , Jiawei Xu , Ziniu Li , Qian Liu , Haoyuan Li

Imitation learning is an effective approach for training game-playing agents and, consequently, for efficient game production. However, generalization - the ability to perform well in related but unseen scenarios - is an essential…

Machine Learning · Computer Science 2024-04-09 Derek Yadgaroff , Alessandro Sestini , Konrad Tollmar , Ayca Ozcelikkale , Linus Gisslén

One of the main challenges in reinforcement learning (RL) is generalisation. In typical deep RL methods this is achieved by approximating the optimal value function with a low-dimensional representation using a deep network. While this…

Machine Learning · Computer Science 2017-11-29 Harm van Seijen , Mehdi Fatemi , Joshua Romoff , Romain Laroche , Tavian Barnes , Jeffrey Tsang

Pixel-based deep reinforcement learning agents are typically trained on heavily downsampled visual observations, a convention inherited from early benchmarks rather than grounded in principled design. In this work, we show that observation…

Machine Learning · Computer Science 2026-05-12 Raphael Trumpp , Ömer Veysel Çağatan , Barış Akgün , Marco Caccamo

This paper proposes a safe reinforcement learning algorithm for generation bidding decisions and unit maintenance scheduling in a competitive electricity market environment. In this problem, each unit aims to find a bidding strategy that…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Pegah Rokhforoz , Olga Fink

Vision-Language-Action (VLA) models have demonstrated significant potential for generalist robotic policies; however, they struggle to generalize to long-horizon complex tasks in novel real-world domains due to distribution shifts and the…

Robotics · Computer Science 2026-02-25 Zhian Su , Weijie Kong , Haonan Dong , Huixu Dong

Policy optimization, which finds the desired policy by maximizing value functions via optimization techniques, lies at the heart of reinforcement learning (RL). In addition to value maximization, other practical considerations arise as…

Machine Learning · Computer Science 2023-01-12 Wenhao Zhan , Shicong Cen , Baihe Huang , Yuxin Chen , Jason D. Lee , Yuejie Chi

Recently, there are many efforts attempting to learn useful policies for continuous control in visual reinforcement learning (RL). In this scenario, it is important to learn a generalizable policy, as the testing environment may differ from…

Machine Learning · Computer Science 2024-10-17 Jiafei Lyu , Le Wan , Xiu Li , Zongqing Lu

In Reinforcement Learning (RL), the goal of agents is to discover an optimal policy that maximizes the expected cumulative rewards. This objective may also be viewed as finding a policy that optimizes a linear function of its state-action…

Machine Learning · Computer Science 2023-08-30 Navdeep Kumar , Kaixin Wang , Kfir Levy , Shie Mannor

Improving generalization and achieving highly predictive, robust machine learning models necessitates learning the underlying causal structure of the variables of interest. A prominent and effective method for this is learning invariant…

Machine Learning · Computer Science 2024-11-12 Jawad Chowdhury , Gabriel Terejanu