中文
相关论文

相关论文: Is AmI (Attacks Meet Interpretability) Robust to A…

200 篇论文

Adversarial defenses protect machine learning models from adversarial attacks, but are often tailored to one type of model or attack. The lack of information on unknown potential attacks makes detecting adversarial examples challenging.…

机器学习 · 计算机科学 2023-09-15 Xinglong Chang , Katharina Dost , Kaiqi Zhao , Ambra Demontis , Fabio Roli , Gill Dobbie , Jörg Wicker

Despite the recent advances in a wide spectrum of applications, machine learning models, especially deep neural networks, have been shown to be vulnerable to adversarial attacks. Attackers add carefully-crafted perturbations to input, where…

机器学习 · 计算机科学 2020-10-08 Ninghao Liu , Mengnan Du , Ruocheng Guo , Huan Liu , Xia Hu

Adversarial examples are malicious inputs crafted to induce misclassification. Commonly studied sensitivity-based adversarial examples introduce semantically-small changes to an input that result in a different model prediction. This paper…

机器学习 · 计算机科学 2020-08-05 Florian Tramèr , Jens Behrmann , Nicholas Carlini , Nicolas Papernot , Jörn-Henrik Jacobsen

Adversarial attack research in natural language processing (NLP) has made significant progress in designing powerful attack methods and defence approaches. However, few efforts have sought to identify which source samples are the most…

计算与语言 · 计算机科学 2023-06-26 Vyas Raina , Mark Gales

Neural Machine Translation (NMT) models have been shown to be vulnerable to adversarial attacks, wherein carefully crafted perturbations of the input can mislead the target model. In this paper, we introduce ACT, a novel adversarial attack…

计算与语言 · 计算机科学 2024-02-23 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

To ensure trust in AI models, it is becoming increasingly apparent that evaluation of models must be extended beyond traditional performance metrics, like accuracy, to other dimensions, such as fairness, explainability, adversarial…

机器学习 · 计算机科学 2021-10-01 Moninder Singh , Gevorg Ghalachyan , Kush R. Varshney , Reginald E. Bryant

Despite the tremendous success of neural networks, benign images can be corrupted by adversarial perturbations to deceive these models. Intriguingly, images differ in their attackability. Specifically, given an attack configuration, some…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Jiaming Liang , Haowei Liu , Chi-Man Pun

Adversarial examples are inputs to machine learning models designed by an adversary to cause an incorrect output. So far, adversarial examples have been studied most extensively in the image domain. In this domain, adversarial examples can…

音频与语音处理 · 电气工程与系统科学 2019-06-10 Yao Qin , Nicholas Carlini , Ian Goodfellow , Garrison Cottrell , Colin Raffel

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

机器学习 · 计算机科学 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

Adversarial Training (AT) is one of the most effective methods to train robust Deep Neural Networks (DNNs). However, AT creates an inherent trade-off between clean accuracy and adversarial robustness, which is commonly attributed to the…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yanyun Wang , Li Liu

Deep neural networks (DNNs) are found to be vulnerable to adversarial noise. They are typically misled by adversarial samples to make wrong predictions. To alleviate this negative effect, in this paper, we investigate the dependence between…

机器学习 · 计算机科学 2022-07-26 Dawei Zhou , Nannan Wang , Xinbo Gao , Bo Han , Xiaoyu Wang , Yibing Zhan , Tongliang Liu

Over the last few years, the phenomenon of adversarial examples --- maliciously constructed inputs that fool trained machine learning models --- has captured the attention of the research community, especially when the adversary is…

机器学习 · 计算机科学 2019-01-31 Nic Ford , Justin Gilmer , Nicolas Carlini , Dogus Cubuk

Automated \enquote{LLM-as-a-Judge} frameworks have become the de facto standard for scalable evaluation across natural language processing. For instance, in safety evaluation, these judges are relied upon to evaluate harmfulness in order to…

计算与语言 · 计算机科学 2026-03-17 Leo Schwinn , Moritz Ladenburger , Tim Beyer , Mehrnaz Mofakhami , Gauthier Gidel , Stephan Günnemann

The field of adversarial robustness has long established that adversarial examples can successfully transfer between image classifiers and that text jailbreaks can successfully transfer between language models (LMs). However, a pair of…

机器学习 · 计算机科学 2025-10-06 Isha Gupta , Rylan Schaeffer , Joshua Kazdan , Ken Ziyu Liu , Sanmi Koyejo

Machine learning models are vulnerable to adversarial examples formed by applying small carefully chosen perturbations to inputs that cause unexpected classification errors. In this paper, we perform experiments on various adversarial…

计算机视觉与模式识别 · 计算机科学 2017-08-08 Andras Rozsa , Manuel Günther , Terrance E. Boult

Deep learning-based discriminative classifiers, despite their remarkable success, remain vulnerable to adversarial examples that can mislead model predictions. While adversarial training can enhance robustness, it fails to address the…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Chunheng Zhao , Pierluigi Pisu , Gurcan Comert , Negash Begashaw , Varghese Vaidyan , Nina Christine Hubig

The growing reliance on deep learning models in safety-critical domains such as healthcare and autonomous navigation underscores the need for defenses that are both robust to adversarial perturbations and transparent in their…

机器学习 · 计算机科学 2026-01-06 Longwei Wang , Mohammad Navid Nayyem , Abdullah Al Rakin , KC Santosh , Chaowei Zhang , Yang Zhou

This paper argues that interpretability research in Artificial Intelligence (AI) is fundamentally ill-posed as existing definitions of interpretability fail to describe how interpretability can be formally tested or designed for. We posit…

As a new programming paradigm, deep learning has expanded its application to many real-world problems. At the same time, deep learning based software are found to be vulnerable to adversarial attacks. Though various defense mechanisms have…

密码学与安全 · 计算机科学 2021-03-16 Zhe Zhao , Guangke Chen , Jingyi Wang , Yiwei Yang , Fu Song , Jun Sun