English
Related papers

Related papers: Blackbox Attacks on Reinforcement Learning Agents …

200 papers

The rapid advancement of artificial intelligence within the realm of cybersecurity raises significant security concerns. The vulnerability of deep learning models in adversarial attacks is one of the major issues. In adversarial machine…

Cryptography and Security · Computer Science 2024-04-18 Khushnaseeb Roshan , Aasim Zafar

As artificial intelligence (AI) assistants become more widely adopted in safety-critical domains, it becomes important to develop safeguards against potential failures or adversarial attacks. A key prerequisite to developing these…

Human-Computer Interaction · Computer Science 2025-04-04 Abed Kareem Musaffar , Anand Gokhale , Sirui Zeng , Rasta Tadayon , Xifeng Yan , Ambuj Singh , Francesco Bullo

Adversarial examples are maliciously tweaked images that can easily fool machine learning techniques, such as neural networks, but they are normally not visually distinguishable for human beings. One of the main approaches to solve this…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Zukang Liao

Robustness of Deep Reinforcement Learning (DRL) algorithms towards adversarial attacks in real world applications such as those deployed in cyber-physical systems (CPS) are of increasing concern. Numerous studies have investigated the…

Machine Learning · Computer Science 2019-11-20 Xian Yeow Lee , Sambit Ghadai , Kai Liang Tan , Chinmay Hegde , Soumik Sarkar

Large Language Models (LLMs) have recently demonstrated significant potential in time series forecasting, offering impressive capabilities in handling complex temporal data. However, their robustness and reliability in real-world…

Machine Learning · Computer Science 2025-03-14 Fuqiang Liu , Sicong Jiang , Luis Miranda-Moreno , Seongjin Choi , Lijun Sun

Reinforcement learning agents are susceptible to evasion attacks during deployment. In single-agent environments, these attacks can occur through imperceptible perturbations injected into the inputs of the victim policy network. In…

Machine Learning · Computer Science 2024-04-29 Xiang Zheng , Xingjun Ma , Shengjie Wang , Xinyu Wang , Chao Shen , Cong Wang

Deep learning has made significant breakthroughs in many fields, including electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, deep learning models are vulnerable to adversarial attacks, in which deliberately…

Machine Learning · Computer Science 2019-11-12 Xue Jiang , Xiao Zhang , Dongrui Wu

Reinforcement learning (RL) has advanced greatly in the past few years with the employment of effective deep neural networks (DNNs) on the policy networks. With the great effectiveness came serious vulnerability issues with DNNs that small…

Machine Learning · Computer Science 2018-07-06 Edgar Tretschk , Seong Joon Oh , Mario Fritz

Deep Reinforcement Learning (RL) agents are susceptible to adversarial noise in their observations that can mislead their policies and decrease their performance. However, an adversary may be interested not only in decreasing the reward,…

Machine Learning · Computer Science 2022-12-13 Dennis Gross , Thiago D. Simao , Nils Jansen , Guillermo A. Perez

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

Empowering safe exploration of reinforcement learning (RL) agents during training is a critical challenge towards their deployment in many real-world scenarios. When prior knowledge of the domain or task is unavailable, training RL agents…

Artificial Intelligence · Computer Science 2025-08-27 Daniel Bethell , Simos Gerasimou , Radu Calinescu , Calum Imrie

Despite the successful application of machine learning (ML) in a wide range of domains, adaptability---the very property that makes machine learning desirable---can be exploited by adversaries to contaminate training and evade…

Deep neural networks have been widely used in various downstream tasks, especially those safety-critical scenario such as autonomous driving, but deep networks are often threatened by adversarial samples. Such adversarial attacks can be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yutong Zhang , Yao Li , Yin Li , Zhichang Guo

Applications of machine learning (ML) models and convolutional neural networks (CNNs) have been rapidly increased. Although state-of-the-art CNNs provide high accuracy in many applications, recent investigations show that such networks are…

Machine Learning · Computer Science 2021-10-18 Hadi Zanddizari , Behnam Zeinali , J. Morris Chang

Deep learning (DL), despite its enormous success in many computer vision and language processing applications, is exceedingly vulnerable to adversarial attacks. We consider the use of DL for radio signal (modulation) classification tasks,…

Information Theory · Computer Science 2018-08-24 Meysam Sadeghi , Erik G. Larsson

We explore the black-box adversarial attack on video recognition models. Attacks are only performed on selected key regions and key frames to reduce the high computation cost of searching adversarial perturbations on a video due to its high…

Cryptography and Security · Computer Science 2021-09-01 Zeyuan Wang , Chaofeng Sha , Su Yang

Recent studies reveal that a well-trained deep reinforcement learning (RL) policy can be particularly vulnerable to adversarial perturbations on input observations. Therefore, it is crucial to train RL agents that are robust against any…

Machine Learning · Computer Science 2022-10-13 Yongyuan Liang , Yanchao Sun , Ruijie Zheng , Furong Huang

The vulnerabilities of deep neural networks against adversarial examples have become a significant concern for deploying these models in sensitive domains. Devising a definitive defense against such attacks is proven to be challenging, and…

Machine Learning · Computer Science 2022-10-04 Xuwang Yin , Soheil Kolouri , Gustavo K. Rohde

Capturing and simulating intelligent adaptive behaviours within spatially explicit individual-based models remains an ongoing challenge for researchers. While an ever-increasing abundance of real-world behavioural data are collected, few…

Multiagent Systems · Computer Science 2022-01-05 Sedar Olmez , Dan Birks , Alison Heppenstall

In this paper, we introduce a black-box prompt optimization method that uses an attacker LLM agent to uncover higher levels of memorization in a victim agent, compared to what is revealed by prompting the target model with the training data…

Computation and Language · Computer Science 2025-02-11 Aly M. Kassem , Omar Mahmoud , Niloofar Mireshghallah , Hyunwoo Kim , Yulia Tsvetkov , Yejin Choi , Sherif Saad , Santu Rana