English
Related papers

Related papers: Enhancing Adversarial Defense by k-Winners-Take-Al…

200 papers

In this paper, we first identify activation shift, a simple but remarkable phenomenon in a neural network in which the preactivation value of a neuron has non-zero mean that depends on the angle between the weight vector of the neuron and…

Neural and Evolutionary Computing · Computer Science 2024-03-22 Takuro Kutsuna

We introduce SPLASH units, a class of learnable activation functions shown to simultaneously improve the accuracy of deep neural networks while also improving their robustness to adversarial attacks. SPLASH units have both a simple…

Machine Learning · Computer Science 2020-06-17 Mohammadamin Tavakoli , Forest Agostinelli , Pierre Baldi

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

Machine Learning · Computer Science 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

Keyless entry systems in cars are adopting neural networks for localizing its operators. Using test-time adversarial defences equip such systems with the ability to defend against adversarial attacks without prior training on adversarial…

Machine Learning · Computer Science 2022-11-14 Abhiram Kolli , Muhammad Jehanzeb Mirza , Horst Possegger , Horst Bischof

The impressive expressive power of deep neural networks (DNNs) underlies their widespread applicability. However, while the theoretical capacity of deep architectures is high, the practical expressive power achieved through successful…

Machine Learning · Computer Science 2023-12-21 Zezhong Zhang , Feng Bao , Guannan Zhang

This paper presents a DNN bottleneck reinforcement scheme to alleviate the vulnerability of Deep Neural Networks (DNN) against adversarial attacks. Typical DNN classifiers encode the input image into a compressed latent representation more…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Wenqing Liu , Miaojing Shi , Teddy Furon , Li Li

Adversarial training has gained great popularity as one of the most effective defenses for deep neural network and more generally for gradient-based machine learning models against adversarial perturbations on data points. This paper…

Machine Learning · Computer Science 2023-05-25 Haotian Gu , Xin Guo , Xinyu Li

In recent years, visual tracking methods based on convolutional neural networks and Transformers have achieved remarkable performance and have been successfully applied in fields such as autonomous driving. However, the numerous security…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Wei-Long Tian , Peng Gao , Xiao Liu , Long Xu , Hamido Fujita , Hanan Aljuai , Mao-Li Wang

Existing gradient-based jailbreak attacks typically optimize an adversarial suffix to induce a fixed affirmative response, e.g., ``Sure, here is...''. However, this fixed target usually resides in an extremely low-density region of a…

Cryptography and Security · Computer Science 2026-01-30 Kedong Xiu , Churui Zeng , Tianhang Zheng , Xinzhe Huang , Xiaojun Jia , Di Wang , Puning Zhao , Zhan Qin , Kui Ren

Recent work has highlighted the vulnerability of many deep machine learning models to adversarial examples. It attracts increasing attention to adversarial attacks, which can be used to evaluate the security and robustness of models before…

Machine Learning · Computer Science 2020-06-22 Xuli Sun , Shiliang Sun

This work addresses meta-learning (ML) by considering deep networks with stochastic local winner-takes-all (LWTA) activations. This type of network units results in sparse representations from each model layer, as the units are organized…

Machine Learning · Computer Science 2022-08-03 Konstantinos Kalais , Sotirios Chatzis

Adversarial training (AT) is a widely recognized defense mechanism to gain the robustness of deep neural networks against adversarial attacks. It is built on min-max optimization (MMO), where the minimizer (i.e., defender) seeks a robust…

Machine Learning · Computer Science 2022-10-06 Yihua Zhang , Guanhua Zhang , Prashant Khanduri , Mingyi Hong , Shiyu Chang , Sijia Liu

The existing work shows that the neural network trained by naive gradient-based optimization method is prone to adversarial attacks, adds small malicious on the ordinary input is enough to make the neural network wrong. At the same time,…

Machine Learning · Computer Science 2024-01-23 Linfeng Ye , Shayan Mohajer Hamidi

Adversarial training is the most effective method to obtain adversarial robustness for deep neural networks by directly involving adversarial samples in the training procedure. To obtain an accurate and robust model, the weighted-average…

Machine Learning · Computer Science 2024-10-23 Zhiyu Xue , Haohan Wang , Yao Qin , Ramtin Pedarsani

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

Most adversarial attack defense methods rely on obfuscating gradients. These methods are successful in defending against gradient-based attacks; however, they are easily circumvented by attacks which either do not use the gradient or by…

Machine Learning · Computer Science 2022-01-14 Mitra Alirezaei , Tolga Tasdizen

We propose a neuromorphic solver for the NP-hard Edge User Allocation problem using an attractor network with Winner-Takes-All (WTA) mechanism implemented with the Bayesian Confidence Propagation Neural Network (BCPNN) framework. Unlike…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Kecheng Zhang , Anders Lansner , Ahsan Javed Awan , Naresh Balaji Ravichandran , Pawel Herman

Deep Neural Networks (DNNs) have recently achieved great success in many tasks, which encourages DNNs to be widely used as a machine learning service in model sharing scenarios. However, attackers can easily generate adversarial examples…

Machine Learning · Computer Science 2019-07-17 Xiaowei Zhou , Ivor W. Tsang , Jie Yin

Despite providing high-performance solutions for computer vision tasks, the deep neural network (DNN) model has been proved to be extremely vulnerable to adversarial attacks. Current defense mainly focuses on the known attacks, but the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Lei Zhang , Yuhang Zhou , Yi Yang , Xinbo Gao

In recent years, deep neural network approaches have been widely adopted for machine learning tasks, including classification. However, they were shown to be vulnerable to adversarial perturbations: carefully crafted small perturbations can…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Pouya Samangouei , Maya Kabkab , Rama Chellappa