中文
相关论文

相关论文: Improving Generalization in Visual Reinforcement L…

200 篇论文

We introduce a method to address goal misgeneralization in reinforcement learning (RL), leveraging Large Language Model (LLM) feedback during training. Goal misgeneralization, a type of robustness failure in RL occurs when an agent retains…

机器学习 · 计算机科学 2024-01-17 Houda Nait El Barj , Theophile Sautory

Deep reinforcement learning (RL) has achieved breakthrough results on many tasks, but agents often fail to generalize beyond the environment they were trained in. As a result, deep RL algorithms that promote generalization are receiving…

机器学习 · 计算机科学 2019-03-18 Charles Packer , Katelyn Gao , Jernej Kos , Philipp Krähenbühl , Vladlen Koltun , Dawn Song

Federated reinforcement learning (FRL) enables distributed learning of optimal policies while preserving local data privacy through gradient sharing.However, FRL faces the risk of data privacy leaks, where attackers exploit shared gradients…

机器学习 · 计算机科学 2025-12-02 Shenghong He

In classic Reinforcement Learning (RL), the agent maximizes an additive objective of the visited states, e.g., a value function. Unfortunately, objectives of this type cannot model many real-world applications such as experiment design,…

机器学习 · 计算机科学 2024-07-16 Riccardo De Santi , Manish Prajapat , Andreas Krause

Recent technological progress in the development of Unmanned Aerial Vehicles (UAVs) together with decreasing acquisition costs make the application of drone fleets attractive for a wide variety of tasks. In agriculture, disaster management,…

机器人学 · 计算机科学 2024-10-30 Yoav Alon , Huiyu Zhou

Despite the rapid progress of neural networks, they remain highly vulnerable to adversarial examples, for which adversarial training (AT) is currently the most effective defense. While AT has been extensively studied, its practical…

机器学习 · 计算机科学 2025-10-16 Yisen Wang , Yichuan Mo , Hongjun Wang , Junyi Li , Zhouchen Lin

While recent progress has spawned very powerful machine learning systems, those agents remain extremely specialized and fail to transfer the knowledge they gain to similar yet unseen tasks. In this paper, we study a simple reinforcement…

机器学习 · 计算机科学 2020-12-15 Remi Tachet , Philip Bachman , Harm van Seijen

Reading comprehension models often overfit to nuances of training datasets and fail at adversarial evaluation. Training with adversarially augmented dataset improves robustness against those adversarial attacks but hurts generalization of…

计算与语言 · 计算机科学 2020-11-18 Adyasha Maharana , Mohit Bansal

We consider reinforcement learning (RL) methods for finding optimal policies in linear quadratic (LQ) mean field control (MFC) problems over an infinite horizon in continuous time, with common noise and entropy regularization. We study…

最优化与控制 · 数学 2024-08-06 Noufel Frikha , Huyên Pham , Xuanye Song

Vision-Language Models (VLMs) demonstrate remarkable general-purpose capabilities but often fall short in specialized domains such as medical imaging or geometric problem-solving. Supervised Fine-Tuning (SFT) can enhance performance within…

计算与语言 · 计算机科学 2026-02-12 Yuming Yan , Shuo Yang , Kai Tang , Sihong Chen , Yang Zhang , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu , Edith C. H. Ngai

A number of results have recently demonstrated the benefits of incorporating various constraints when training deep architectures in vision and machine learning. The advantages range from guarantees for statistical generalization to better…

机器学习 · 计算机科学 2019-05-27 Sathya N. Ravi , Tuan Dinh , Vishnu Lokhande , Vikas Singh

A fundamental challenge for multi-task learning is that different tasks may conflict with each other when they are solved jointly, and a cause of this phenomenon is conflicting gradients during optimization. Recent works attempt to mitigate…

机器学习 · 计算机科学 2023-02-23 Guangyuan Shi , Qimai Li , Wenlong Zhang , Jiaxin Chen , Xiao-Ming Wu

Generalization in reinforcement learning (RL) is of importance for real deployment of RL algorithms. Various schemes are proposed to address the generalization issues, including transfer learning, multi-task learning and meta learning, as…

机器学习 · 计算机科学 2022-10-07 Chang Yang , Ruiyu Wang , Xinrun Wang , Zhen Wang

Visual reinforcement learning (RL), which makes decisions directly from high-dimensional visual inputs, has demonstrated significant potential in various domains. However, deploying visual RL techniques in the real world remains challenging…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Guozheng Ma , Zhen Wang , Zhecheng Yuan , Xueqian Wang , Bo Yuan , Dacheng Tao

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across…

机器学习 · 计算机科学 2020-09-18 Dong Yin , Raphael Gontijo Lopes , Jonathon Shlens , Ekin D. Cubuk , Justin Gilmer

Autonomous agents must often deal with conflicting requirements, such as completing tasks using the least amount of time/energy, learning multiple tasks, or dealing with multiple opponents. In the context of reinforcement learning~(RL),…

机器学习 · 计算机科学 2019-10-30 Santiago Paternain , Luiz F. O. Chamon , Miguel Calvo-Fullana , Alejandro Ribeiro

Graphical User Interface (GUI) Agents, benefiting from recent advances in multimodal large language models (MLLM), have achieved significant development. However, due to the frequent updates of GUI applications, adapting to new tasks…

机器学习 · 计算机科学 2026-03-10 Zhenquan Yao , Zitong Huang , Yihan Zeng , Jianhua Han , Hang Xu , Chun-Mei Feng , Jianwei Ma , Wangmeng Zuo

Guiding the policy of multi-agent reinforcement learning to align with human common sense is a difficult problem, largely due to the complexity of modeling common sense as a reward, especially in complex and long-horizon multi-agent tasks.…

人工智能 · 计算机科学 2025-02-20 Hao Ma , Shijie Wang , Zhiqiang Pu , Siyao Zhao , Xiaolin Ai

This work focuses on enhancing the generalization performance of deep reinforcement learning-based robot navigation in unseen environments. We present a novel data augmentation approach called scenario augmentation, which enables robots to…

机器人学 · 计算机科学 2025-03-04 Shanze Wang , Mingao Tan , Zhibo Yang , Xianghui Wang , Xiaoyu Shen , Hailong Huang , Wei Zhang

Goal-conditioned reinforcement learning (GCRL), related to a set of complex RL problems, trains an agent to achieve different goals under particular scenarios. Compared to the standard RL solutions that learn a policy solely depending on…

人工智能 · 计算机科学 2022-09-05 Minghuan Liu , Menghui Zhu , Weinan Zhang