English
Related papers

Related papers: DARD: Dice Adversarial Robustness Distillation aga…

200 papers

Deep neural networks (DNNs) have proven to be quite effective in a vast array of machine learning tasks, with recent examples in cyber security and autonomous vehicles. Despite the superior performance of DNNs in these applications, it has…

Machine Learning · Computer Science 2017-08-22 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , Xue Liu , C. Lee Giles

Although the recent progress is substantial, deep learning methods can be vulnerable to the maliciously generated adversarial examples. In this paper, we present a novel training procedure and a thresholding test strategy, towards robust…

Machine Learning · Computer Science 2018-11-08 Tianyu Pang , Chao Du , Yinpeng Dong , Jun Zhu

Upon the discovery of adversarial attacks, robust models have become obligatory for deep learning-based systems. Adversarial training with first-order attacks has been one of the most effective defenses against adversarial perturbations to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Inci M. Baytas , Debayan Deb

It is well-known that deep neural networks (DNNs) are susceptible to adversarial attacks, exposing a severe fragility of deep learning systems. As the result, adversarial training (AT) method, by incorporating adversarial examples during…

Machine Learning · Computer Science 2022-03-01 Tuan Anh Bui , Trung Le , Quan Tran , He Zhao , Dinh Phung

Dataset distillation aims to encapsulate the rich information contained in dataset into a compact distilled dataset but it faces performance degradation as the image-per-class (IPC) setting or image resolution grows larger. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Lexiao Zou , Gongwei Chen , Yanda Chen , Miao Zhang

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Knowledge distillation has become an important approach to obtain a compact yet effective model. To achieve this goal, a small student model is trained to exploit the knowledge of a large well-trained teacher model. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Zhiqiang Liu , Chengkai Huang , Yanxia Liu

In clinics, doctors rely on electrocardiograms (ECGs) to assess severe cardiac disorders. Owing to the development of technology and the increase in health awareness, ECG signals are currently obtained by using medical and commercial…

Signal Processing · Electrical Eng. & Systems 2022-03-18 Jiahao Shao , Shijia Geng , Zhaoji Fu , Weilun Xu , Tong Liu , Shenda Hong

In this work, we consider model robustness of deep neural networks against adversarial attacks from a global manifold perspective. Leveraging both the local and global latent information, we propose a novel adversarial training method…

Machine Learning · Computer Science 2022-10-04 Zhuang Qian , Shufei Zhang , Kaizhu Huang , Qiufeng Wang , Rui Zhang , Xinping Yi

Although deep neural networks (DNNs) have achieved success in many application fields, it is still vulnerable to imperceptible adversarial examples that can lead to misclassification of DNNs easily. To overcome this challenge, many…

Machine Learning · Computer Science 2020-08-11 Yaguan Qian , Ximin Zhang , Bin Wang , Wei Li , Zhaoquan Gu , Haijiang Wang , Wassim Swaileh

Adversarial Training (AT) has been demonstrated to improve the robustness of deep neural networks (DNNs) against adversarial attacks. AT is a min-max optimization procedure where in adversarial examples are generated to train a more robust…

Machine Learning · Computer Science 2024-12-31 Olukorede Fakorede , Modeste Atsague , Jin Tian

Diffusion models are the main driver of progress in image and video synthesis, but suffer from slow inference speed. Distillation methods, like the recently introduced adversarial diffusion distillation (ADD) aim to shift the model from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Axel Sauer , Frederic Boesel , Tim Dockhorn , Andreas Blattmann , Patrick Esser , Robin Rombach

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

The phenomenon of adversarial examples illustrates one of the most basic vulnerabilities of deep neural networks. Among the variety of techniques introduced to surmount this inherent weakness, adversarial training has emerged as the most…

Machine Learning · Computer Science 2022-09-14 Matan Levi , Idan Attias , Aryeh Kontorovich

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Deep learning has achieved great success in computer vision, but remains vulnerable to adversarial attacks. Adversarial training is the leading defense designed to improve model robustness. However, its effect on the transferability of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Mohamed Awad , Mahmoud Akrm , Walid Gomaa

With the deployment of Large Language Models (LLMs) in interactive applications, online malicious intent detection has become increasingly critical. However, existing approaches fall short of handling diverse and complex user queries in…

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Federated learning (FL) is a distributed training technology that enhances data privacy in mobile edge networks by allowing data owners to collaborate without transmitting raw data to the edge server. However, data heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yu Qiao , Apurba Adhikary , Kitae Kim , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Although the diffusion model has achieved remarkable performance in the field of image generation, its high inference delay hinders its wide application in edge devices with scarce computing resources. Therefore, many training-free sampling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Weilun Feng , Chuanguang Yang , Zhulin An , Libo Huang , Boyu Diao , Fei Wang , Yongjun Xu