English
Related papers

Related papers: Adversarial Examples in Random Neural Networks wit…

200 papers

We investigate the sample complexity of bounded two-layer neural networks using different activation functions. In particular, we consider the class $$ \mathcal{H} = \left\{\textbf{x}\mapsto \langle \textbf{v}, \sigma \circ W\textbf{b} +…

Machine Learning · Computer Science 2024-01-23 Amit Daniely , Elad Granot

Deep Neural Networks are vulnerable to adversarial examples, i.e., carefully crafted input samples that can cause models to make incorrect predictions with high confidence. To mitigate these vulnerabilities, adversarial training and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Francesco Villani , Igor Maljkovic , Dario Lazzaro , Angelo Sotgiu , Antonio Emanuele Cinà , Fabio Roli

Robustness is an increasingly important property of machine learning models as they become more and more prevalent. We propose a defense against adversarial examples based on a k-nearest neighbor (kNN) on the intermediate activation of…

Machine Learning · Computer Science 2020-03-20 Chawin Sitawarin , David Wagner

Recent advances in mechanistic interpretability suggest that intermediate attention layers encode token-level hypotheses that are iteratively refined toward the final output. In this work, we exploit this property to generate adversarial…

Computation and Language · Computer Science 2026-01-01 Kaustubh Dhole

Designing deep networks robust to adversarial examples remains an open problem. Likewise, recent zeroth order hard-label attacks on image classification models have shown comparable performance to their first-order, gradient-level…

Machine Learning · Computer Science 2021-03-08 Washington Garcia , Pin-Yu Chen , Somesh Jha , Scott Clouse , Kevin R. B. Butler

Word-level adversarial attacks have shown success in NLP models, drastically decreasing the performance of transformer-based models in recent years. As a countermeasure, adversarial defense has been explored, but relatively few efforts have…

Computation and Language · Computer Science 2022-03-04 KiYoon Yoo , Jangho Kim , Jiho Jang , Nojun Kwak

Deep Neural Networks (DNNs) have shown remarkable performance in a diverse range of machine learning applications. However, it is widely known that DNNs are vulnerable to simple adversarial perturbations, which causes the model to…

Machine Learning · Computer Science 2021-07-23 Gihyuk Ko , Gyumin Lim

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

Deep neural network (DNN) models are wellknown to easily misclassify prediction results by using input images with small perturbations, called adversarial examples. In this paper, we propose a novel adversarial detector, which consists of a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Takayuki Osakabe , Maungmaung Aprilpyone , Sayaka Shiota , Hitoshi Kiya

Several machine learning models, including neural networks, consistently misclassify adversarial examples---inputs formed by applying small but intentionally worst-case perturbations to examples from the dataset, such that the perturbed…

Machine Learning · Statistics 2015-03-24 Ian J. Goodfellow , Jonathon Shlens , Christian Szegedy

Adversarial examples are a hot topic due to their abilities to fool a classifier's prediction. There are two strategies to create such examples, one uses the attacked classifier's gradients, while the other only requires access to the…

Machine Learning · Computer Science 2020-01-29 Jean-Christophe Burnel , Kilian Fatras , Nicolas Courty

Keyless entry systems in cars are adopting neural networks for localizing its operators. Using test-time adversarial defences equip such systems with the ability to defend against adversarial attacks without prior training on adversarial…

Machine Learning · Computer Science 2022-11-14 Abhiram Kolli , Muhammad Jehanzeb Mirza , Horst Possegger , Horst Bischof

Empirical studies have widely demonstrated that neural networks are highly sensitive to small, adversarial perturbations of the input. The worst-case robustness against these so-called adversarial examples can be quantified by the Lipschitz…

Machine Learning · Statistics 2025-07-03 Paul Geuchen , Dominik Stöger , Thomas Telaar , Felix Voigtlaender

Adversarial examples are a widely studied phenomenon in machine learning models. While most of the attention has been focused on neural networks, other practical models also suffer from this issue. In this work, we propose an algorithm for…

Machine Learning · Computer Science 2021-11-02 Chawin Sitawarin , Evgenios M. Kornaropoulos , Dawn Song , David Wagner

Adversarial Attacks are still a significant challenge for neural networks. Recent work has shown that adversarial perturbations typically contain high-frequency features, but the root cause of this phenomenon remains unknown. Inspired by…

Machine Learning · Statistics 2023-03-10 Josue Ortega Caro , Yilong Ju , Ryan Pyle , Sourav Dey , Wieland Brendel , Fabio Anselmi , Ankit Patel

The success of deep networks has been attributed in part to their expressivity: per parameter, deep networks can approximate a richer class of functions than shallow networks. In ReLU networks, the number of activation patterns is one…

Machine Learning · Statistics 2019-10-22 Boris Hanin , David Rolnick

Adversarial examples have attracted significant attention in machine learning, but the reasons for their existence and pervasiveness remain unclear. We demonstrate that adversarial examples can be directly attributed to the presence of…

Machine Learning · Statistics 2019-08-13 Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Logan Engstrom , Brandon Tran , Aleksander Madry

Machine learning algorithms have been shown to be vulnerable to adversarial manipulation through systematic modification of inputs (e.g., adversarial examples) in domains such as image recognition. Under the default threat model, the…

Cryptography and Security · Computer Science 2022-09-12 Ryan Sheatsley , Nicolas Papernot , Michael Weisman , Gunjan Verma , Patrick McDaniel

The susceptibility of modern machine learning classifiers to adversarial examples has motivated theoretical results suggesting that these might be unavoidable. However, these results can be too general to be applicable to natural data…

Machine Learning · Computer Science 2024-05-28 Ambar Pal , Jeremias Sulam , René Vidal

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

Machine Learning · Computer Science 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu