English
Related papers

Related papers: DARD: Dice Adversarial Robustness Distillation aga…

200 papers

This paper addresses the problem of decentralized learning to achieve a high-performance global model by asking a group of clients to share local models pre-trained with their own data resources. We are particularly interested in a specific…

Machine Learning · Computer Science 2020-08-19 Jiaxin Ma , Ryo Yonetani , Zahid Iqbal

Machine learning is vulnerable to adversarial examples: inputs carefully modified to force misclassification. Designing defenses against such inputs remains largely an open problem. In this work, we revisit defensive distillation---which is…

Machine Learning · Computer Science 2017-05-16 Nicolas Papernot , Patrick McDaniel

Deep learning models have achieved state-of-the-art performances in various domains, while they are vulnerable to the inputs with well-crafted but small perturbations, which are named after adversarial examples (AEs). Among many strategies…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Huihui Gong

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

We present a novel adversarial penalized self-knowledge distillation method, named adversarial learning and implicit regularization for self-knowledge distillation (AI-KD), which regularizes the training procedure by adversarial learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Hyungmin Kim , Sungho Suh , Sunghyun Baek , Daehwan Kim , Daun Jeong , Hansang Cho , Junmo Kim

We propose Algorithm Distillation (AD), a method for distilling reinforcement learning (RL) algorithms into neural networks by modeling their training histories with a causal sequence model. Algorithm Distillation treats learning to…

Vision-Language Models (VLMs) are increasingly deployed in safety-critical applications, making their adversarial robustness a crucial concern. While adversarial knowledge distillation has shown promise in transferring robustness from…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yuqi Li , Junhao Dong , Chuanguang Yang , Shiping Wen , Piotr Koniusz , Tingwen Huang , Yingli Tian , Yew-Soon Ong

Adversarial training is a defense method that trains machine learning models on intentionally perturbed attack inputs, so they learn to be robust against adversarial examples. This paper develops a robust voltage control framework for…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Sungjoo Chung , Ying Zhang

Large pre-trained Vision-Language Models (VLMs) such as Contrastive Language-Image Pre-training (CLIP) have been shown to be susceptible to adversarial attacks, raising concerns about their deployment in safety-critical applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Lin Luo , Xin Wang , Bojia Zi , Shihao Zhao , Xingjun Ma , Yu-Gang Jiang

While multi-exit neural networks are regarded as a promising solution for making efficient inference via early exits, combating adversarial attacks remains a challenging problem. In multi-exit networks, due to the high dependency among…

Machine Learning · Computer Science 2023-11-02 Seokil Ham , Jungwuk Park , Dong-Jun Han , Jaekyun Moon

Distribution Matching Distillation (DMD) is a promising score distillation technique that compresses pre-trained teacher diffusion models into efficient one-step or multi-step student generators. Nevertheless, its reliance on the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Yanzuo Lu , Yuxi Ren , Xin Xia , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Andy J. Ma , Xiaohua Xie , Jian-Huang Lai

Blind super-resolution methods based on stable diffusion showcase formidable generative capabilities in reconstructing clear high-resolution images with intricate details from low-resolution inputs. However, their practical applicability is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Rui Xie , Chen Zhao , Kai Zhang , Zhenyu Zhang , Jun Zhou , Jian Yang , Ying Tai

Latent diffusion models have recently demonstrated superior capabilities in many downstream image synthesis tasks. However, customization of latent diffusion models using unauthorized data can severely compromise the privacy and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Sen Peng , Mingyue Wang , Jianfei He , Jijia Yang , Xiaohua Jia

The study of physical adversarial patches is crucial for identifying vulnerabilities in AI-based recognition systems and developing more robust deep learning models. While recent research has focused on improving patch stealthiness for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wei Liu , Yonglin Wu , Chaoqun Li , Zhuodong Liu , Huanqian Yan

Dataset distillation (DD) compresses a large training set into a small synthetic set for efficient training, but most DD methods optimize only clean accuracy and leave robustness uncontrolled. Recent robust DD methods improve robustness,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Muquan Li , Yingyi Ma , Yihong Huang , Hang Gou , Ke Qin , Ming Li , Yuan-Fang Li , Tao He

Despite the remarkable progress of deep neural networks (DNNs) in various visual tasks, their vulnerability to adversarial examples raises significant security concerns. Recent adversarial training methods leverage inverse adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kejia Zhang , Juanjuan Weng , Shaozi Li , Zhiming Luo

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad