English
Related papers

Related papers: Revisiting Adversarial Robustness Distillation: Ro…

200 papers

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Neural language models show vulnerability to adversarial examples which are semantically similar to their original counterparts with a few words replaced by their synonyms. A common way to improve model robustness is adversarial training…

Computation and Language · Computer Science 2022-03-25 Hanjie Chen , Yangfeng Ji

Supervised learning methods trained with maximum likelihood objectives often overfit on training data. Most regularizers that prevent overfitting look to increase confidence on additional examples (e.g., data augmentation, adversarial…

Machine Learning · Computer Science 2022-06-06 Amrith Setlur , Benjamin Eysenbach , Virginia Smith , Sergey Levine

Traditional dataset distillation primarily focuses on image representation while often overlooking the important role of labels. In this study, we introduce Label-Augmented Dataset Distillation (LADD), a new dataset distillation framework…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Seoungyoon Kang , Youngsun Lim , Hyunjung Shim

We present a novel adversarial penalized self-knowledge distillation method, named adversarial learning and implicit regularization for self-knowledge distillation (AI-KD), which regularizes the training procedure by adversarial learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Hyungmin Kim , Sungho Suh , Sunghyun Baek , Daehwan Kim , Daun Jeong , Hansang Cho , Junmo Kim

Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nuoyan Zhou , Nannan Wang , Decheng Liu , Dawei Zhou , Xinbo Gao

Despite the remarkable progress of deep neural networks (DNNs) in various visual tasks, their vulnerability to adversarial examples raises significant security concerns. Recent adversarial training methods leverage inverse adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kejia Zhang , Juanjuan Weng , Shaozi Li , Zhiming Luo

The comparative losses (typically, triplet loss) are appealing choices for learning person re-identification (ReID) features. However, the triplet loss is computationally much more expensive than the (practically more popular)…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Ye Yuan , Wuyang Chen , Yang Yang , Zhangyang Wang

As machine learning models grow in complexity and increasingly rely on publicly sourced data, such as the human-annotated labels used in training large language models, they become more vulnerable to label poisoning attacks. These attacks,…

Machine Learning · Computer Science 2025-02-25 Melis Ilayda Bal , Volkan Cevher , Michael Muehlebach

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

Machine Learning · Computer Science 2025-02-10 Binghui Li , Yuanzhi Li

Diffusion models (DMs) have achieved remarkable success in text-to-image generation, but they also pose safety risks, such as the potential generation of harmful content and copyright violations. The techniques of machine unlearning, also…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yimeng Zhang , Xin Chen , Jinghan Jia , Yihua Zhang , Chongyu Fan , Jiancheng Liu , Mingyi Hong , Ke Ding , Sijia Liu

Automatic modulation classification (AMC) is an effective way to deal with physical layer threats of the internet of things (IoT). However, there is often label mislabeling in practice, which significantly impacts the performance and…

Machine Learning · Computer Science 2024-08-12 Xiaoyang Hao , Zhixi Feng , Tongqing Peng , Shuyuan Yang

Noisy labels (NL) and adversarial examples both undermine trained models, but interestingly they have hitherto been studied independently. A recent adversarial training (AT) study showed that the number of projected gradient descent (PGD)…

Machine Learning · Computer Science 2021-02-10 Jianing Zhu , Jingfeng Zhang , Bo Han , Tongliang Liu , Gang Niu , Hongxia Yang , Mohan Kankanhalli , Masashi Sugiyama

This work focuses on plant leaf disease classification and explores three crucial aspects: adversarial training, model explainability, and model compression. The models' robustness against adversarial attacks is enhanced through adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Sebastian-Vasile Echim , Iulian-Marius Tăiatu , Dumitru-Clementin Cercel , Florin Pop

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Adversarial Training (AT), which adversarially perturb the input samples during training, has been acknowledged as one of the most effective defenses against adversarial attacks, yet suffers from inevitably decreased clean accuracy. Instead…

Machine Learning · Computer Science 2024-06-06 Yihao Zhang , Hangzhou He , Jingyu Zhu , Huanran Chen , Yifei Wang , Zeming Wei

Recent breakthroughs in the field of deep learning have led to advancements in a broad spectrum of tasks in computer vision, audio processing, natural language processing and other areas. In most instances where these tasks are deployed in…

Machine Learning · Computer Science 2019-05-28 Daanish Ali Khan , Linhong Li , Ninghao Sha , Zhuoran Liu , Abelino Jimenez , Bhiksha Raj , Rita Singh

Adversarial training (AT) for robust representation learning and self-supervised learning (SSL) for unsupervised representation learning are two active research fields. Integrating AT into SSL, multiple prior works have accomplished a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Chaoning Zhang , Kang Zhang , Chenshuang Zhang , Axi Niu , Jiu Feng , Chang D. Yoo , In So Kweon

Federated learning (FL) has gained significant attention for enabling decentralized training on edge networks without exposing raw data. However, FL models remain susceptible to adversarial attacks and performance degradation in non-IID…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yu Qiao , Apurba Adhikary , Huy Q. Le , Eui-Nam Huh , Zhu Han , Choong Seon Hong