English
Related papers

Related papers: Houdini: Fooling Deep Structured Prediction Models

200 papers

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

Human-machine interaction is increasingly dependent on speech communication. Machine Learning models are usually applied to interpret human speech commands. However, these models can be fooled by adversarial examples, which are inputs…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Jon Vadillo , Roberto Santana

Several machine learning models, including neural networks, consistently misclassify adversarial examples---inputs formed by applying small but intentionally worst-case perturbations to examples from the dataset, such that the perturbed…

Machine Learning · Statistics 2015-03-24 Ian J. Goodfellow , Jonathon Shlens , Christian Szegedy

Machine Learning models have been shown to be vulnerable to adversarial examples, ie. the manipulation of data by a attacker to defeat a defender's classifier at test time. We present a novel probabilistic definition of adversarial examples…

Machine Learning · Statistics 2018-01-09 Martin Gubri

Adversarial examples are input examples that are specifically crafted to deceive machine learning classifiers. State-of-the-art adversarial example detection methods characterize an input example as adversarial either by quantifying the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yuhang Wu , Sunpreet S. Arora , Yanhong Wu , Hao Yang

Recently, many studies have demonstrated deep neural network (DNN) classifiers can be fooled by the adversarial example, which is crafted via introducing some perturbations into an original sample. Accordingly, some powerful defense…

Cryptography and Security · Computer Science 2019-01-10 Bin Liang , Hongcheng Li , Miaoqiang Su , Xirong Li , Wenchang Shi , Xiaofeng Wang

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Deep neural networks are susceptible to adversarial attacks, which pose a significant threat to their security and reliability in real-world applications. The most notable adversarial attacks are transfer-based attacks, where an adversary…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Kunyu Wang , Juluan Shi , Wenxuan Wang

In spite of intense research efforts, deep neural networks remain vulnerable to adversarial examples: an input that forces the network to confidently produce incorrect outputs. Adversarial examples are typically generated by an attack…

Artificial Intelligence · Computer Science 2023-02-02 David Aaron Nicholson , Vincent Emanuele

Deep Neural Networks (DNNs) have shown remarkable performance in a diverse range of machine learning applications. However, it is widely known that DNNs are vulnerable to simple adversarial perturbations, which causes the model to…

Machine Learning · Computer Science 2021-07-23 Gihyuk Ko , Gyumin Lim

The great success of convolutional neural networks has caused a massive spread of the use of such models in a large variety of Computer Vision applications. However, these models are vulnerable to certain inputs, the adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Stefanos Pertigkiozoglou , Petros Maragos

Compared with traditional machine learning models, deep neural networks perform better, especially in image classification tasks. However, they are vulnerable to adversarial examples. Adding small perturbations on examples causes a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Zifei Zhang , Kai Qiao , Lingyun Jiang , Linyuan Wang , Bin Yan

Building an effective adversarial attacker and elaborating on countermeasures for adversarial attacks for natural language processing (NLP) have attracted a lot of research in recent years. However, most of the existing approaches focus on…

Computation and Language · Computer Science 2020-10-20 Wenjuan Han , Liwen Zhang , Yong Jiang , Kewei Tu

The renaissance of deep learning has led to the massive development of automated driving. However, deep neural networks are vulnerable to adversarial examples. The perturbations of adversarial examples are imperceptible to human eyes but…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Jun Yan , Huilin Yin

Machine learning is vulnerable to adversarial examples: inputs carefully modified to force misclassification. Designing defenses against such inputs remains largely an open problem. In this work, we revisit defensive distillation---which is…

Machine Learning · Computer Science 2017-05-16 Nicolas Papernot , Patrick McDaniel

Recently, substantial progress has been made in language modeling by using deep neural networks. However, in practice, large scale neural language models have been shown to be prone to overfitting. In this paper, we present a simple yet…

Machine Learning · Computer Science 2019-09-10 Dilin Wang , Chengyue Gong , Qiang Liu

Adversarial examples are data points misclassified by neural networks. Originally, adversarial examples were limited to adding small perturbations to a given image. Recent work introduced the generalized concept of unrestricted adversarial…

Machine Learning · Computer Science 2020-05-20 Martin Kotuliak , Sandro E. Schoenborn , Andrei Dan

This paper explores the use of adversarial examples in training speech recognition systems to increase robustness of deep neural network acoustic models. During training, the fast gradient sign method is used to generate adversarial…

Computation and Language · Computer Science 2018-06-19 Sining Sun , Ching-Feng Yeh , Mari Ostendorf , Mei-Yuh Hwang , Lei Xie

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara