中文
相关论文

相关论文: Optimal Attacks on Reinforcement Learning Policies

200 篇论文

In offline multi-agent reinforcement learning (MARL), agents estimate policies from a given dataset. We study reward-poisoning attacks in this setting where an exogenous attacker modifies the rewards in the dataset before the agents see the…

机器学习 · 计算机科学 2023-03-09 Young Wu , Jeremy McMahan , Xiaojin Zhu , Qiaomin Xie

Policies trained via reinforcement learning (RL) are often very complex even for simple tasks. In an episode with $n$ time steps, a policy will make $n$ decisions on actions to take, many of which may appear non-intuitive to the observer.…

人工智能 · 计算机科学 2021-11-17 Daniel McNamee , Hana Chockler

Machine learning techniques are currently used extensively for automating various cybersecurity tasks. Most of these techniques utilize supervised learning algorithms that rely on training the algorithm to classify incoming data into…

密码学与安全 · 计算机科学 2019-12-06 Prithviraj Dasgupta , Joseph B. Collins

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

机器学习 · 计算机科学 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Information theory has been very successful in obtaining performance limits for various problems such as communication, compression and hypothesis testing. Likewise, stochastic control theory provides a characterization of optimal policies…

信息论 · 计算机科学 2018-10-15 Dhruva Kartik , Ekraam Sabir , Urbashi Mitra , Prem Natarajan

We study the optimal design of stealthy attacks against partially observed linear control systems. We first propose a novel likelihood-based detection mechanism derived from the innovation process, based on which we quantify stealthiness…

最优化与控制 · 数学 2026-05-12 Haosheng Zhou , Ruimeng Hu

Adversarial ranking attacks have gained increasing attention due to their success in probing vulnerabilities, and, hence, enhancing the robustness, of neural ranking models. Conventional attack methods employ perturbations at a single…

信息检索 · 计算机科学 2024-04-12 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, collaborative manipulation by robotic arms, and multi-target encirclement. However, potential…

机器学习 · 计算机科学 2024-06-27 Oubo Ma , Yuwen Pu , Linkang Du , Yang Dai , Ruo Wang , Xiaolei Liu , Yingcai Wu , Shouling Ji

Reinforcement learning generalizes multi-armed bandit problems with additional difficulties of a longer planning horizon and unknown transition kernel. We explore a black-box reduction from discounted infinite-horizon tabular reinforcement…

机器学习 · 计算机科学 2024-03-12 Ian A. Kash , Lev Reyzin , Zishun Yu

Reinforcement learning is generally difficult for partially observable Markov decision processes (POMDPs), which occurs when the agent's observation is partial or noisy. To seek good performance in POMDPs, one strategy is to endow the agent…

机器学习 · 计算机科学 2021-11-19 Mario Geiger , Christophe Eloy , Matthieu Wyart

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

机器学习 · 计算机科学 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts

Transfer learning has become a common practice for training deep learning models with limited labeled data in a target domain. On the other hand, deep models are vulnerable to adversarial attacks. Though transfer learning has been widely…

机器学习 · 计算机科学 2020-08-26 Yinghua Zhang , Yangqiu Song , Jian Liang , Kun Bai , Qiang Yang

Learning a near optimal policy in a partially observable system remains an elusive challenge in contemporary reinforcement learning. In this work, we consider episodic reinforcement learning in a reward-mixing Markov decision process (MDP).…

机器学习 · 计算机科学 2022-02-01 Jeongyeol Kwon , Yonathan Efroni , Constantine Caramanis , Shie Mannor

With further development in the fields of computer vision, network security, natural language processing and so on so forth, deep learning technology gradually exposed certain security risks. The existing deep learning algorithms cannot…

密码学与安全 · 计算机科学 2020-11-18 Rui Zhao

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

人工智能 · 计算机科学 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

机器学习 · 计算机科学 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

机器学习 · 计算机科学 2026-01-16 Nadav Merlis

Manipulating the interaction trajectories between the intelligent agent and the environment can control the agent's training and behavior, exposing the potential vulnerabilities of reinforcement learning (RL). For example, in Cyber-Physical…

机器学习 · 计算机科学 2024-11-21 Zhi Luo , Xiyuan Yang , Pan Zhou , Di Wang

We consider the problem of strategic classification, where a learner must build a model to classify agents based on features that have been strategically modified. Previous work in this area has concentrated on the case when the learner is…

机器学习 · 计算机科学 2025-05-19 Jack Geary , Henry Gouk

Reinforcement learning (RL) has demonstrated its ability to solve high dimensional tasks by leveraging non-linear function approximators. However, these successes are mostly achieved by 'black-box' policies in simulated domains. When…

机器学习 · 计算机科学 2021-11-19 Riad Akrour , Davide Tateo , Jan Peters