中文
相关论文

相关论文: Blackbox Attacks on Reinforcement Learning Agents …

200 篇论文

As reinforcement learning agents become increasingly deployed in real-world scenarios, predicting future agent actions and events during deployment is important for facilitating better human-agent interaction and preventing catastrophic…

人工智能 · 计算机科学 2024-10-31 Stephen Chung , Scott Niekum , David Krueger

Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can…

机器学习 · 计算机科学 2019-12-11 Yandong Li , Lijun Li , Liqiang Wang , Tong Zhang , Boqing Gong

Adversarial transferability in black-box scenarios presents a unique challenge: while attackers can employ surrogate models to craft adversarial examples, they lack assurance on whether these examples will successfully compromise the target…

机器学习 · 计算机科学 2024-04-19 Mosh Levy , Guy Amit , Yuval Elovici , Yisroel Mirsky

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

机器学习 · 计算机科学 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Automatic speaker verification systems are increasingly used as the primary means to authenticate costumers. Recently, it has been proposed to train speaker verification systems using end-to-end deep neural models. In this paper, we show…

机器学习 · 计算机科学 2018-02-19 Felix Kreuk , Yossi Adi , Moustapha Cisse , Joseph Keshet

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

人工智能 · 计算机科学 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Machine learning (ML) classifiers are vulnerable to adversarial examples. An adversarial example is an input sample which is slightly modified to induce misclassification in an ML classifier. In this work, we investigate white-box and…

密码学与安全 · 计算机科学 2019-04-17 Yonghong Huang , Utkarsh Verma , Celeste Fralick , Gabriel Infante-Lopez , Brajesh Kumarz , Carl Woodward

The safety and robustness of learning-based decision-making systems are under threats from adversarial examples, as imperceptible perturbations can mislead neural networks to completely different outputs. In this paper, we present an…

机器学习 · 计算机科学 2019-11-28 Chao Tang , Yifei Fan , Anthony Yezzi

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

机器学习 · 计算机科学 2020-03-02 Qian Huang , Isay Katsman , Horace He , Zeqi Gu , Serge Belongie , Ser-Nam Lim

In the last decade, deep neural networks have proven to be very powerful in computer vision tasks, starting a revolution in the computer vision and machine learning fields. However, deep neural networks, usually, are not robust to…

计算机视觉与模式识别 · 计算机科学 2021-05-03 Hao Qiu , Leonardo Lucio Custode , Giovanni Iacca

Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying…

计算与语言 · 计算机科学 2020-12-29 Sachin Saxena

Recently, generating adversarial examples has become an important means of measuring robustness of a deep learning model. Adversarial examples help us identify the susceptibilities of the model and further counter those vulnerabilities by…

机器学习 · 计算机科学 2021-03-03 Prashanth Vijayaraghavan , Deb Roy

Deep neural networks are vulnerable to adversarial examples -- minor perturbations added to a model's input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Chris Miller , Soroush Vosoughi

Audio adversarial examples (AEs) have posed significant security challenges to real-world speaker recognition systems. Most black-box attacks still require certain information from the speaker recognition model to be effective (e.g.,…

声音 · 计算机科学 2023-11-21 Rui Duan , Zhe Qu , Leah Ding , Yao Liu , Zhuo Lu

The vulnerability of the high-performance machine learning models implies a security risk in applications with real-world consequences. Research on adversarial attacks is beneficial in guiding the development of machine learning models on…

机器学习 · 计算机科学 2022-11-16 Yiran Huang , Yexu Zhou , Michael Hefenbrock , Till Riedel , Likun Fang , Michael Beigl

Clustering algorithms are used in a large number of applications and play an important role in modern machine learning-- yet, adversarial attacks on clustering algorithms seem to be broadly overlooked unlike supervised learning. In this…

机器学习 · 计算机科学 2019-11-19 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

机器学习 · 计算机科学 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

Adversarial attacks based on randomized search schemes have obtained state-of-the-art results in black-box robustness evaluation recently. However, as we demonstrate in this work, their efficiency in different query budget regimes depends…

机器学习 · 计算机科学 2021-11-23 Maksym Yatsura , Jan Hendrik Metzen , Matthias Hein

Machine learning based intrusion detection systems are increasingly targeted by black box adversarial attacks, where attackers craft evasive inputs using indirect feedback such as binary outputs or behavioral signals like response time and…

密码学与安全 · 计算机科学 2025-12-16 Sabrine Ennaji , Elhadj Benkhelifa , Luigi Vincenzo Mancini

The evolution of large language models into autonomous agents introduces adversarial failures that exploit legitimate tool privileges, transforming safety evaluation in tool-augmented environments from a subjective NLP task into an…

机器学习 · 计算机科学 2026-02-03 Samuel Nellessen , Tal Kachman