中文
相关论文

相关论文: Towards Optimal Adversarial Robust Q-learning with…

200 篇论文

Deep Reinforcement Learning (DRL) has achieved remarkable advances in sequential decision tasks. However, recent works have revealed that DRL agents are susceptible to slight perturbations in observations. This vulnerability raises concerns…

机器学习 · 计算机科学 2023-12-15 Buqing Nie , Jingtian Ji , Yangqing Fu , Yue Gao

Deep Reinforcement Learning (RL) is unquestionably a robust framework to train autonomous agents in a wide variety of disciplines. However, traditional deep and shallow model-free RL algorithms suffer from low sample efficiency and…

机器学习 · 计算机科学 2022-10-05 Per-Arne Andersen , Ole-Christoffer Granmo , Morten Goodwin

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating…

机器学习 · 计算机科学 2020-06-02 Linfang Hou , Liang Pang , Xin Hong , Yanyan Lan , Zhiming Ma , Dawei Yin

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

机器学习 · 计算机科学 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

Recent studies reveal that a well-trained deep reinforcement learning (RL) policy can be particularly vulnerable to adversarial perturbations on input observations. Therefore, it is crucial to train RL agents that are robust against any…

机器学习 · 计算机科学 2022-10-13 Yongyuan Liang , Yanchao Sun , Ruijie Zheng , Furong Huang

Offline reinforcement learning promises policy improvement from logged interaction data alone, yet state-of-the-art algorithms remain vulnerable to value over-estimation and to violations of domain knowledge such as monotonicity or…

系统与控制 · 电气工程与系统科学 2025-06-18 Ali Baheri

Dynamic Algorithm Configuration (DAC) studies the efficient identification of control policies for parameterized optimization algorithms. Numerous studies leverage Reinforcement Learning (RL) to address DAC challenges; however, applying RL…

机器学习 · 计算机科学 2026-04-03 Tai Nguyen , Phong Le , André Biedenkapp , Carola Doerr , Nguyen Dang

Deep reinforcement learning (DRL) has demonstrated remarkable success in developing autonomous driving policies. However, its vulnerability to adversarial attacks remains a critical barrier to real-world deployment. Although existing robust…

机器学习 · 计算机科学 2025-11-11 Junchao Fan , Qi Wei , Ruichen Zhang , Dusit Niyato , Yang Lu , Jianhua Wang , Xiaolin Chang , Bo Ai

Reinforcement learning (RL) algorithms have been successfully applied to a range of challenging sequential decision making and control tasks. In this paper, we classify RL into direct and indirect RL according to how they seek the optimal…

机器学习 · 计算机科学 2021-05-12 Yang Guan , Shengbo Eben Li , Jingliang Duan , Jie Li , Yangang Ren , Qi Sun , Bo Cheng

Traditional reinforcement learning (RL) aims to maximize the expected total reward, while the risk of uncertain outcomes needs to be controlled to ensure reliable performance in a risk-averse setting. In this paper, we consider the problem…

机器学习 · 计算机科学 2023-01-18 Xian Yu , Siqian Shen

To ensure the usefulness of Reinforcement Learning (RL) in real systems, it is crucial to ensure they are robust to noise and adversarial attacks. In adversarial RL, an external attacker has the power to manipulate the victim agent's…

机器学习 · 计算机科学 2024-06-18 Jeremy McMahan , Young Wu , Xiaojin Zhu , Qiaomin Xie

In this paper, we study the offline RL problem with linear function approximation. Our main structural assumption is that the MDP has low inherent Bellman error, which stipulates that linear value functions have linear Bellman backups with…

机器学习 · 计算机科学 2024-06-19 Noah Golowich , Ankur Moitra

Recently, deep reinforcement learning (DRL) has emerged as a promising approach for robotic control. However, the deployment of DRL in real-world robots is hindered by its sensitivity to environmental perturbations. While existing whitebox…

机器学习 · 计算机科学 2025-03-27 Zongyuan Zhang , Tianyang Duan , Zheng Lin , Dong Huang , Zihan Fang , Zekai Sun , Ling Xiong , Hongbin Liang , Heming Cui , Yong Cui

Deep Reinforcement Learning (RL) has shown remarkable success in robotics with complex and heterogeneous dynamics. However, its vulnerability to unknown disturbances and adversarial attacks remains a significant challenge. In this paper, we…

机器人学 · 计算机科学 2024-10-01 Hanyang Hu , Xilun Zhang , Xubo Lyu , Mo Chen

We study reinforcement learning in infinite-horizon discounted Markov decision processes with continuous state spaces, where data are generated online from a single trajectory under a Markovian behavior policy. To avoid maintaining an…

机器学习 · 计算机科学 2026-03-05 Shengbo Wang

Recently, there has been a surge of interest in analyzing the non-asymptotic behavior of model-free reinforcement learning algorithms. However, the performance of such algorithms in non-ideal environments, such as in the presence of…

机器学习 · 计算机科学 2024-09-06 Sreejeet Maity , Aritra Mitra

As deep learning models are increasingly deployed in high-risk applications, robust defenses against adversarial attacks and reliable performance guarantees become paramount. Moreover, accuracy alone does not provide sufficient assurance or…

机器学习 · 计算机科学 2025-06-10 Jie Bao , Chuangyin Dang , Rui Luo , Hanwei Zhang , Zhixin Zhou

We introduce robustness in \textit{restless multi-armed bandits} (RMABs), a popular model for constrained resource allocation among independent stochastic processes (arms). Nearly all RMAB techniques assume stochastic dynamics are precisely…

机器学习 · 计算机科学 2022-06-23 Jackson A. Killian , Lily Xu , Arpita Biswas , Milind Tambe

Deep reinforcement learning (DRL) is vulnerable to adversarial perturbations. Adversaries can mislead the policies of DRL agents by perturbing the state of the environment observed by the agents. Existing attacks are feasible in principle,…

机器学习 · 计算机科学 2022-09-26 Buse G. A. Tekgul , Shelly Wang , Samuel Marchal , N. Asokan

Deep Reinforcement Learning (DRL) policies have been shown to be vulnerable to small adversarial noise in observations. Such adversarial noise can have disastrous consequences in safety-critical environments. For instance, a self-driving…

机器学习 · 计算机科学 2024-03-28 Roman Belaire , Pradeep Varakantham , Thanh Nguyen , David Lo