English
Related papers

Related papers: Denoising Autoencoder-based Defensive Distillation…

200 papers

Due to the prosperity of Artificial Intelligence (AI) techniques, more and more backdoors are designed by adversaries to attack Deep Neural Networks (DNNs).Although the state-of-the-art method Neural Attention Distillation (NAD) can…

Machine Learning · Computer Science 2022-04-26 Jun Xia , Ting Wang , Jiepin Ding , Xian Wei , Mingsong Chen

Adversarial Robustness Distillation (ARD) is a novel method to boost the robustness of small models. Unlike general adversarial training, its robust knowledge transfer can be less easily restricted by the model capacity. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Yuzheng Wang , Zhaoyu Chen , Dingkang Yang , Yang Liu , Siao Liu , Wenqiang Zhang , Lizhe Qi

Deep Neural Networks (DNNs) have shown remarkable performance in a diverse range of machine learning applications. However, it is widely known that DNNs are vulnerable to simple adversarial perturbations, which causes the model to…

Machine Learning · Computer Science 2021-07-23 Gihyuk Ko , Gyumin Lim

Deep neural networks (DNNs) are vulnerable to adversarial examples with small perturbations. Adversarial defense thus has been an important means which improves the robustness of DNNs by defending against adversarial examples. Existing…

Machine Learning · Computer Science 2021-03-16 Jincheng Li , Jiezhang Cao , Yifan Zhang , Jian Chen , Mingkui Tan

Deep Neural Networks (DNNs) have significantly advanced the field of computer vision. To improve DNN training process, knowledge distillation methods demonstrate their effectiveness in accelerating network training by introducing a fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Daqian Shi , Xiaolei Diao , Xu Chen , Cédric M. John

Adversarial distillation (AD) is a knowledge distillation technique that facilitates the transfer of robustness from teacher deep neural network (DNN) models to lightweight target (student) DNN models, enabling the target models to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Zhenyu Liu , Huizhi Liang , Xinrun Li , Vaclav Snasel , Varun Ojha

Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can…

Machine Learning · Computer Science 2019-12-11 Yandong Li , Lijun Li , Liqiang Wang , Tong Zhang , Boqing Gong

Deep Neural Networks (DNNs) have been shown to be vulnerable to adversarial examples. While numerous successful adversarial attacks have been proposed, defenses against these attacks remain relatively understudied. Existing defense…

Machine Learning · Computer Science 2025-06-17 Furkan Mumcu , Yasin Yilmaz

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are…

Computation and Language · Computer Science 2021-04-22 Wenqi Wang , Run Wang , Lina Wang , Zhibo Wang , Aoshuang Ye

Text-to-image diffusion models have revolutionized generative AI, but their vulnerability to backdoor attacks poses significant security risks. Adversaries can inject imperceptible textual triggers into training data, causing models to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ashwath Vaithinathan Aravindan , Abha Jha , Matthew Salaway , Atharva Sandeep Bhide , Duygu Nur Yaldiz

Deep learning has made tremendous advances in computer vision tasks such as image classification. However, recent studies have shown that deep learning models are vulnerable to specifically crafted adversarial inputs that are…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Kirthi Shankar Sivamani

The field of textual adversarial defenses has gained considerable attention in recent years due to the increasing vulnerability of natural language processing (NLP) models to adversarial attacks, which exploit subtle perturbations in input…

Computation and Language · Computer Science 2024-12-11 Wangli Yang , Jie Yang , Yi Guo , Johan Barthelemy

Adversarial training is a widely adopted strategy to bolster the robustness of neural network models against adversarial attacks. This paper revisits the fundamental assumptions underlying image classification and suggests that representing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Erh-Chung Chen , Che-Rung Lee

Dataset distillation has emerged as a prominent technique to improve data efficiency when training machine learning models. It encapsulates the knowledge from a large dataset into a smaller synthetic dataset. A model trained on this smaller…

Cryptography and Security · Computer Science 2023-01-04 Yugeng Liu , Zheng Li , Michael Backes , Yun Shen , Yang Zhang

Adversarial training is one effective approach for training robust deep neural networks against adversarial attacks. While being able to bring reliable robustness, adversarial training (AT) methods in general favor high capacity models,…

Cryptography and Security · Computer Science 2021-08-19 Bojia Zi , Shihao Zhao , Xingjun Ma , Yu-Gang Jiang

We present a novel adversarial penalized self-knowledge distillation method, named adversarial learning and implicit regularization for self-knowledge distillation (AI-KD), which regularizes the training procedure by adversarial learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Hyungmin Kim , Sungho Suh , Sunghyun Baek , Daehwan Kim , Daun Jeong , Hansang Cho , Junmo Kim

Deep neural networks (DNNs) could be deceived by generating human-imperceptible perturbations of clean samples. Therefore, enhancing the robustness of DNNs against adversarial attacks is a crucial task. In this paper, we aim to train robust…

Machine Learning · Computer Science 2024-01-23 Shayan Mohajer Hamidi , Linfeng Ye

Recent studies have shown that deep convolutional neural networks (DCNN) are vulnerable to adversarial examples and sensitive to perceptual quality as well as the acquisition condition of images. These findings raise a big concern for the…

Machine Learning · Computer Science 2020-04-15 Yeli Feng , Yiyu Cai

Unlearnable examples (UEs) seek to maximize testing error by making subtle modifications to training examples that are correctly labeled. Defenses against these poisoning attacks can be categorized based on whether specific interventions…

Cryptography and Security · Computer Science 2024-05-07 Yi Yu , Yufei Wang , Song Xia , Wenhan Yang , Shijian Lu , Yap-Peng Tan , Alex C. Kot

Gradient-based adversarial attacks on neural networks can be crafted in a variety of ways by varying either how the attack algorithm relies on the gradient, the network architecture used for crafting the attack, or both. Most recent work…

Machine Learning · Computer Science 2020-01-28 Rehana Mahfuz , Rajeev Sahay , Aly El Gamal