English
Related papers

Related papers: Localized Uncertainty Attacks

200 papers

Machine learning based solutions have been very helpful in solving problems that deal with immense amounts of data, such as malware detection and classification. However, deep neural networks have been found to be vulnerable to adversarial…

Cryptography and Security · Computer Science 2020-11-12 Daniel Park , Bülent Yener

Adversarial attacks modify images with perturbations that change the prediction of classifiers. These modified images, known as adversarial examples, expose the vulnerabilities of deep neural network classifiers. In this paper, we…

Machine Learning · Computer Science 2022-06-03 Chau Yi Li , Ricardo Sánchez-Matilla , Ali Shahin Shamsabadi , Riccardo Mazzon , Andrea Cavallaro

Deep learning models are known to solve classification and regression problems by employing a number of epoch and training samples on a large dataset with optimal accuracy. However, that doesn't mean they are attack-proof or unexposed to…

Cryptography and Security · Computer Science 2019-05-10 Chris Einar San Agustin

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

Deep neural networks have been shown to exhibit an intriguing vulnerability to adversarial input images corrupted with imperceptible perturbations. However, the majority of adversarial attacks assume global, fine-grained control over the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Ameya Joshi , Amitangshu Mukherjee , Soumik Sarkar , Chinmay Hegde

The phenomenon of adversarial examples in deep learning models has caused substantial concern over their reliability. While many deep neural networks have shown impressive performance in terms of predictive accuracy, it has been shown that…

Machine Learning · Computer Science 2021-06-28 Sadia Chowdhury , Ruth Urner

Deep neural network architectures are considered to be robust to random perturbations. Nevertheless, it was shown that they could be severely vulnerable to slight but carefully crafted perturbations of the input, termed as adversarial…

Machine Learning · Computer Science 2021-02-16 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil

The rapid advancement of artificial intelligence within the realm of cybersecurity raises significant security concerns. The vulnerability of deep learning models in adversarial attacks is one of the major issues. In adversarial machine…

Cryptography and Security · Computer Science 2024-04-18 Khushnaseeb Roshan , Aasim Zafar

Adversarial machine learning is an emerging field that focuses on studying vulnerabilities of machine learning approaches in adversarial settings and developing techniques accordingly to make learning robust to adversarial manipulations. It…

Quantum Physics · Physics 2020-08-11 Sirui Lu , Lu-Ming Duan , Dong-Ling Deng

In this work we present a formal theoretical framework for assessing and analyzing two classes of malevolent action towards generic Artificial Intelligence (AI) systems. Our results apply to general multi-class classifiers that map from an…

Machine Learning · Computer Science 2021-01-01 Ivan Y. Tyukin , Desmond J. Higham , Alexander N. Gorban

Adversarial examples are malicious inputs crafted to induce misclassification. Commonly studied sensitivity-based adversarial examples introduce semantically-small changes to an input that result in a different model prediction. This paper…

Machine Learning · Computer Science 2020-08-05 Florian Tramèr , Jens Behrmann , Nicholas Carlini , Nicolas Papernot , Jörn-Henrik Jacobsen

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

Machine Learning · Computer Science 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

Adversarial examples are malicious inputs crafted to cause a model to misclassify them. Their most common instantiation, "perturbation-based" adversarial examples introduce changes to the input that leave its true label unchanged, yet…

Machine Learning · Computer Science 2019-03-26 Jörn-Henrik Jacobsen , Jens Behrmannn , Nicholas Carlini , Florian Tramèr , Nicolas Papernot

Neural network based classifiers are still prone to manipulation through adversarial perturbations. State of the art attacks can overcome most of the defense or detection mechanisms suggested so far, and adversaries have the upper hand in…

Machine Learning · Computer Science 2018-12-05 Ziv Katzir , Yuval Elovici

Deep learning models achieve remarkable accuracy in computer vision tasks, yet remain vulnerable to adversarial examples--carefully crafted perturbations to input images that can deceive these models into making confident but incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Khoi Nguyen Tiet Nguyen , Wenyu Zhang , Kangkang Lu , Yuhuan Wu , Xingjian Zheng , Hui Li Tan , Liangli Zhen

Neural networks are known to be vulnerable to adversarial examples, inputs that have been intentionally perturbed to remain visually similar to the source input, but cause a misclassification. It was recently shown that given a dataset and…

Cryptography and Security · Computer Science 2018-01-08 Jamie Hayes , George Danezis

Adversarial examples are carefully crafted attack points that are supposed to fool machine learning classifiers. In the last years, the field of adversarial machine learning, especially the study of perturbation-based adversarial examples,…

Machine Learning · Computer Science 2023-09-19 Roland Rauter , Martin Nocker , Florian Merkle , Pascal Schöttle

What fundamentally distinguishes an adversarial attack from a misclassification due to limited model expressivity or finite data? In this work, we investigate this question in the setting of high-dimensional binary classification, where…

Machine Learning · Statistics 2025-06-17 Matteo Vilucchio , Lenka Zdeborová , Bruno Loureiro

Deep learning models are susceptible to adversarial attacks, where slight perturbations to input data lead to misclassification. Adversarial attacks become increasingly effective with access to information about the targeted classifier. In…

Machine Learning · Computer Science 2024-05-29 Yu Zhe , Rei Nagaike , Daiki Nishiyama , Kazuto Fukuchi , Jun Sakuma

Deep learning models, while achieving state-of-the-art performance on many tasks, are susceptible to adversarial attacks that exploit inherent vulnerabilities in their architectures. Adversarial attacks manipulate the input data with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shreyasi Mandal