English
Related papers

Related papers: Improving Generalization in Visual Reinforcement L…

200 papers

We introduce a method to address goal misgeneralization in reinforcement learning (RL), leveraging Large Language Model (LLM) feedback during training. Goal misgeneralization, a type of robustness failure in RL occurs when an agent retains…

Machine Learning · Computer Science 2024-01-17 Houda Nait El Barj , Theophile Sautory

Deep reinforcement learning (RL) has achieved breakthrough results on many tasks, but agents often fail to generalize beyond the environment they were trained in. As a result, deep RL algorithms that promote generalization are receiving…

Machine Learning · Computer Science 2019-03-18 Charles Packer , Katelyn Gao , Jernej Kos , Philipp Krähenbühl , Vladlen Koltun , Dawn Song

Federated reinforcement learning (FRL) enables distributed learning of optimal policies while preserving local data privacy through gradient sharing.However, FRL faces the risk of data privacy leaks, where attackers exploit shared gradients…

Machine Learning · Computer Science 2025-12-02 Shenghong He

In classic Reinforcement Learning (RL), the agent maximizes an additive objective of the visited states, e.g., a value function. Unfortunately, objectives of this type cannot model many real-world applications such as experiment design,…

Machine Learning · Computer Science 2024-07-16 Riccardo De Santi , Manish Prajapat , Andreas Krause

Recent technological progress in the development of Unmanned Aerial Vehicles (UAVs) together with decreasing acquisition costs make the application of drone fleets attractive for a wide variety of tasks. In agriculture, disaster management,…

Robotics · Computer Science 2024-10-30 Yoav Alon , Huiyu Zhou

Despite the rapid progress of neural networks, they remain highly vulnerable to adversarial examples, for which adversarial training (AT) is currently the most effective defense. While AT has been extensively studied, its practical…

Machine Learning · Computer Science 2025-10-16 Yisen Wang , Yichuan Mo , Hongjun Wang , Junyi Li , Zhouchen Lin

While recent progress has spawned very powerful machine learning systems, those agents remain extremely specialized and fail to transfer the knowledge they gain to similar yet unseen tasks. In this paper, we study a simple reinforcement…

Machine Learning · Computer Science 2020-12-15 Remi Tachet , Philip Bachman , Harm van Seijen

Reading comprehension models often overfit to nuances of training datasets and fail at adversarial evaluation. Training with adversarially augmented dataset improves robustness against those adversarial attacks but hurts generalization of…

Computation and Language · Computer Science 2020-11-18 Adyasha Maharana , Mohit Bansal

We consider reinforcement learning (RL) methods for finding optimal policies in linear quadratic (LQ) mean field control (MFC) problems over an infinite horizon in continuous time, with common noise and entropy regularization. We study…

Optimization and Control · Mathematics 2024-08-06 Noufel Frikha , Huyên Pham , Xuanye Song

Vision-Language Models (VLMs) demonstrate remarkable general-purpose capabilities but often fall short in specialized domains such as medical imaging or geometric problem-solving. Supervised Fine-Tuning (SFT) can enhance performance within…

Computation and Language · Computer Science 2026-02-12 Yuming Yan , Shuo Yang , Kai Tang , Sihong Chen , Yang Zhang , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu , Edith C. H. Ngai

A number of results have recently demonstrated the benefits of incorporating various constraints when training deep architectures in vision and machine learning. The advantages range from guarantees for statistical generalization to better…

Machine Learning · Computer Science 2019-05-27 Sathya N. Ravi , Tuan Dinh , Vishnu Lokhande , Vikas Singh

A fundamental challenge for multi-task learning is that different tasks may conflict with each other when they are solved jointly, and a cause of this phenomenon is conflicting gradients during optimization. Recent works attempt to mitigate…

Machine Learning · Computer Science 2023-02-23 Guangyuan Shi , Qimai Li , Wenlong Zhang , Jiaxin Chen , Xiao-Ming Wu

Generalization in reinforcement learning (RL) is of importance for real deployment of RL algorithms. Various schemes are proposed to address the generalization issues, including transfer learning, multi-task learning and meta learning, as…

Machine Learning · Computer Science 2022-10-07 Chang Yang , Ruiyu Wang , Xinrun Wang , Zhen Wang

Visual reinforcement learning (RL), which makes decisions directly from high-dimensional visual inputs, has demonstrated significant potential in various domains. However, deploying visual RL techniques in the real world remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Guozheng Ma , Zhen Wang , Zhecheng Yuan , Xueqian Wang , Bo Yuan , Dacheng Tao

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across…

Machine Learning · Computer Science 2020-09-18 Dong Yin , Raphael Gontijo Lopes , Jonathon Shlens , Ekin D. Cubuk , Justin Gilmer

Autonomous agents must often deal with conflicting requirements, such as completing tasks using the least amount of time/energy, learning multiple tasks, or dealing with multiple opponents. In the context of reinforcement learning~(RL),…

Machine Learning · Computer Science 2019-10-30 Santiago Paternain , Luiz F. O. Chamon , Miguel Calvo-Fullana , Alejandro Ribeiro

Graphical User Interface (GUI) Agents, benefiting from recent advances in multimodal large language models (MLLM), have achieved significant development. However, due to the frequent updates of GUI applications, adapting to new tasks…

Machine Learning · Computer Science 2026-03-10 Zhenquan Yao , Zitong Huang , Yihan Zeng , Jianhua Han , Hang Xu , Chun-Mei Feng , Jianwei Ma , Wangmeng Zuo

Guiding the policy of multi-agent reinforcement learning to align with human common sense is a difficult problem, largely due to the complexity of modeling common sense as a reward, especially in complex and long-horizon multi-agent tasks.…

Artificial Intelligence · Computer Science 2025-02-20 Hao Ma , Shijie Wang , Zhiqiang Pu , Siyao Zhao , Xiaolin Ai

This work focuses on enhancing the generalization performance of deep reinforcement learning-based robot navigation in unseen environments. We present a novel data augmentation approach called scenario augmentation, which enables robots to…

Robotics · Computer Science 2025-03-04 Shanze Wang , Mingao Tan , Zhibo Yang , Xianghui Wang , Xiaoyu Shen , Hailong Huang , Wei Zhang

Goal-conditioned reinforcement learning (GCRL), related to a set of complex RL problems, trains an agent to achieve different goals under particular scenarios. Compared to the standard RL solutions that learn a policy solely depending on…

Artificial Intelligence · Computer Science 2022-09-05 Minghuan Liu , Menghui Zhu , Weinan Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›