English
Related papers

Related papers: Blackbox Attacks on Reinforcement Learning Agents …

200 papers

As reinforcement learning agents become increasingly deployed in real-world scenarios, predicting future agent actions and events during deployment is important for facilitating better human-agent interaction and preventing catastrophic…

Artificial Intelligence · Computer Science 2024-10-31 Stephen Chung , Scott Niekum , David Krueger

Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can…

Machine Learning · Computer Science 2019-12-11 Yandong Li , Lijun Li , Liqiang Wang , Tong Zhang , Boqing Gong

Adversarial transferability in black-box scenarios presents a unique challenge: while attackers can employ surrogate models to craft adversarial examples, they lack assurance on whether these examples will successfully compromise the target…

Machine Learning · Computer Science 2024-04-19 Mosh Levy , Guy Amit , Yuval Elovici , Yisroel Mirsky

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

Machine Learning · Computer Science 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Automatic speaker verification systems are increasingly used as the primary means to authenticate costumers. Recently, it has been proposed to train speaker verification systems using end-to-end deep neural models. In this paper, we show…

Machine Learning · Computer Science 2018-02-19 Felix Kreuk , Yossi Adi , Moustapha Cisse , Joseph Keshet

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Machine learning (ML) classifiers are vulnerable to adversarial examples. An adversarial example is an input sample which is slightly modified to induce misclassification in an ML classifier. In this work, we investigate white-box and…

Cryptography and Security · Computer Science 2019-04-17 Yonghong Huang , Utkarsh Verma , Celeste Fralick , Gabriel Infante-Lopez , Brajesh Kumarz , Carl Woodward

The safety and robustness of learning-based decision-making systems are under threats from adversarial examples, as imperceptible perturbations can mislead neural networks to completely different outputs. In this paper, we present an…

Machine Learning · Computer Science 2019-11-28 Chao Tang , Yifei Fan , Anthony Yezzi

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2020-03-02 Qian Huang , Isay Katsman , Horace He , Zeqi Gu , Serge Belongie , Ser-Nam Lim

In the last decade, deep neural networks have proven to be very powerful in computer vision tasks, starting a revolution in the computer vision and machine learning fields. However, deep neural networks, usually, are not robust to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Hao Qiu , Leonardo Lucio Custode , Giovanni Iacca

Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying…

Computation and Language · Computer Science 2020-12-29 Sachin Saxena

Recently, generating adversarial examples has become an important means of measuring robustness of a deep learning model. Adversarial examples help us identify the susceptibilities of the model and further counter those vulnerabilities by…

Machine Learning · Computer Science 2021-03-03 Prashanth Vijayaraghavan , Deb Roy

Deep neural networks are vulnerable to adversarial examples -- minor perturbations added to a model's input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Chris Miller , Soroush Vosoughi

Audio adversarial examples (AEs) have posed significant security challenges to real-world speaker recognition systems. Most black-box attacks still require certain information from the speaker recognition model to be effective (e.g.,…

Sound · Computer Science 2023-11-21 Rui Duan , Zhe Qu , Leah Ding , Yao Liu , Zhuo Lu

The vulnerability of the high-performance machine learning models implies a security risk in applications with real-world consequences. Research on adversarial attacks is beneficial in guiding the development of machine learning models on…

Machine Learning · Computer Science 2022-11-16 Yiran Huang , Yexu Zhou , Michael Hefenbrock , Till Riedel , Likun Fang , Michael Beigl

Clustering algorithms are used in a large number of applications and play an important role in modern machine learning-- yet, adversarial attacks on clustering algorithms seem to be broadly overlooked unlike supervised learning. In this…

Machine Learning · Computer Science 2019-11-19 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

Machine Learning · Computer Science 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

Adversarial attacks based on randomized search schemes have obtained state-of-the-art results in black-box robustness evaluation recently. However, as we demonstrate in this work, their efficiency in different query budget regimes depends…

Machine Learning · Computer Science 2021-11-23 Maksym Yatsura , Jan Hendrik Metzen , Matthias Hein

Machine learning based intrusion detection systems are increasingly targeted by black box adversarial attacks, where attackers craft evasive inputs using indirect feedback such as binary outputs or behavioral signals like response time and…

Cryptography and Security · Computer Science 2025-12-16 Sabrine Ennaji , Elhadj Benkhelifa , Luigi Vincenzo Mancini

The evolution of large language models into autonomous agents introduces adversarial failures that exploit legitimate tool privileges, transforming safety evaluation in tool-augmented environments from a subjective NLP task into an…

Machine Learning · Computer Science 2026-02-03 Samuel Nellessen , Tal Kachman