English
Related papers

Related papers: Enhancing Adversarial Defense by k-Winners-Take-Al…

200 papers

Modern deep neural networks (DNNs) are vulnerable to adversarial attacks and adversarial training has been shown to be a promising method for improving the adversarial robustness of DNNs. Pruning methods have been considered in adversarial…

Machine Learning · Computer Science 2022-03-08 Xupeng Shi , Pengfei Zheng , A. Adam Ding , Yuan Gao , Weizhong Zhang

Gradient-based adversarial attacks subtly manipulate inputs of Machine Learning (ML) models to induce incorrect predictions. This paper investigates whether careful architectural choices alone can yield an inherently robust Deep Neural…

Machine Learning · Computer Science 2026-05-19 Mohamed elShehaby , Ashraf Matrawy

It is well-known that deep neural networks are vulnerable to adversarial attacks. Recent studies show that well-designed classification parts can lead to better robustness. However, there is still much space for improvement along this line.…

Machine Learning · Computer Science 2020-10-09 Cong Xu , Dan Li , Min Yang

This work attempts to address adversarial robustness of deep networks by means of novel learning arguments. Specifically, inspired from results in neuroscience, we propose a local competition principle as a means of adversarially-robust…

Machine Learning · Computer Science 2020-06-19 Antonios Alexos , Konstantinos P. Panousis , Sotirios Chatzis

It is commonly believed that networks cannot be both accurate and robust, that gaining robustness means losing accuracy. It is also generally believed that, unless making networks larger, network architectural elements would otherwise…

Machine Learning · Computer Science 2021-07-13 Cihang Xie , Mingxing Tan , Boqing Gong , Alan Yuille , Quoc V. Le

We study the robustness against adversarial examples of kNN classifiers and classifiers that combine kNN with neural networks. The main difficulty lies in the fact that finding an optimal attack on kNN is intractable for typical datasets.…

Machine Learning · Computer Science 2020-03-17 Chawin Sitawarin , David Wagner

Recent works have demonstrated convolutional neural networks are vulnerable to adversarial examples, i.e., inputs to machine learning models that an attacker has intentionally designed to cause the models to make a mistake. To improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xianxu Hou , Jingxin Liu , Bolei Xu , Xiaolong Wang , Bozhi Liu , Guoping Qiu

Adversarial training (AT) is one of the most effective ways for improving the robustness of deep convolution neural networks (CNNs). Just like common network training, the effectiveness of AT relies on the design of basic network…

Machine Learning · Computer Science 2022-12-06 Qing Guo , Felix Juefei-Xu , Changqing Zhou , Wei Feng , Yang Liu , Song Wang

Artificial spike-based computation, inspired by models of computation in the central nervous system, may present significant performance advantages over traditional methods for specific types of large scale problems. This paper describes…

Neurons and Cognition · Quantitative Biology 2007-05-23 Wei Wang , Jean-Jacques E. Slotine

Though deep neural networks (DNNs) have shown superiority over other techniques in major fields like computer vision, natural language processing, robotics, recently, it has been proven that they are vulnerable to adversarial attacks. The…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Nupur Thakur , Yuzhen Ding , Baoxin Li

Nowadays, Deep Learning as a service can be deployed in Internet of Things (IoT) to provide smart services and sensor data processing. However, recent research has revealed that some Deep Neural Networks (DNN) can be easily misled by adding…

Cryptography and Security · Computer Science 2020-10-22 Ling Wang , Cheng Zhang , Zejian Luo , Chenguang Liu , Jie Liu , Xi Zheng , Athanasios Vasilakos

Adversarial training is an effective but time-consuming way to train robust deep neural networks that can withstand strong adversarial attacks. As a response to its inefficiency, we propose Dynamic Efficient Adversarial Training (DEAT),…

Machine Learning · Computer Science 2023-03-15 Fu Wang , Yanghao Zhang , Yanbin Zheng , Wenjie Ruan

In standard Deep Neural Network (DNN) based classifiers, the general convention is to omit the activation function in the last (output) layer and directly apply the softmax function on the logits to get the probability scores of each class.…

Machine Learning · Computer Science 2022-05-17 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil

Recent work shows that deep neural networks are vulnerable to adversarial examples. Much work studies adversarial example generation, while very little work focuses on more critical adversarial defense. Existing adversarial detection…

Machine Learning · Computer Science 2021-09-15 Bin Zhu , Zhaoquan Gu , Le Wang , Zhihong Tian

In this paper, we study the adversarial attack and defence problem in deep learning from the perspective of Fourier analysis. We first explicitly compute the Fourier transform of deep ReLU neural networks and show that there exist decaying…

Machine Learning · Computer Science 2019-05-31 Yuping Lin , Kasra Ahmadi K. A. , Hui Jiang

Adversarial examples contain small perturbations that can remain imperceptible to human observers but alter the behavior of even the best performing deep learning models and yield incorrect outputs. Since their discovery, adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Andras Rozsa , Terrance E. Boult

In this article, we propose a novel Winner-Take-All (WTA) architecture employing neurons with nonlinear dendrites and an online unsupervised structural plasticity rule for training it. Further, to aid hardware implementations, our network…

Neural and Evolutionary Computing · Computer Science 2015-12-07 Subhrajit Roy , Arindam Basu

Deep Neural Networks (DNNs) are highly vulnerable to adversarial examples, which pose significant challenges in security-sensitive applications. Among various adversarial attack strategies, input transformation-based attacks have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Hangyu Liu , Bo Peng , Can Cui , Pengxiang Ding , Donglin Wang

Deep neural networks have been shown to be vulnerable to adversarial examples---maliciously crafted examples that can trigger the target model to misbehave by adding imperceptible perturbations. Existing attack methods for k-nearest…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Xiaodan Li , Yuefeng Chen , Yuan He , Hui Xue

To mitigate the susceptibility of neural networks to adversarial attacks, adversarial training has emerged as a prevalent and effective defense strategy. Intrinsically, this countermeasure incurs a trade-off, as it sacrifices the model's…

Machine Learning · Computer Science 2024-09-19 Hanyi Hu , Qiao Han , Kui Chen , Yao Yang