中文
相关论文

相关论文: DAFT: Distilling Adversarially Fine-tuned Models f…

200 篇论文

Adversarial training and its many variants substantially improve deep network robustness, yet at the cost of compromising standard accuracy. Moreover, the training process is heavy and hence it becomes impractical to thoroughly explore the…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Haotao Wang , Tianlong Chen , Shupeng Gui , Ting-Kuei Hu , Ji Liu , Zhangyang Wang

Face recognition systems have raised concerns due to their vulnerability to different presentation attacks, and system security has become an increasingly critical concern. Although many face anti-spoofing (FAS) methods perform well in…

计算机视觉与模式识别 · 计算机科学 2024-01-03 Zhe Kong , Wentian Zhang , Tao Wang , Kaihao Zhang , Yuexiang Li , Xiaoying Tang , Wenhan Luo

A pre-trained language model, BERT, has brought significant performance improvements across a range of natural language processing tasks. Since the model is trained on a large corpus of diverse topics, it shows robust performance for domain…

计算与语言 · 计算机科学 2020-10-26 Minho Ryu , Kichun Lee

Adversarial training is one of the most effective methods for enhancing model robustness. Recent approaches incorporate adversarial distillation in adversarial training architectures. However, we notice two scenarios of defense methods that…

机器学习 · 计算机科学 2024-08-26 Zhenyu Liu , Haoran Duan , Huizhi Liang , Yang Long , Vaclav Snasel , Guiseppe Nicosia , Rajiv Ranjan , Varun Ojha

The phenomenon of adversarial examples illustrates one of the most basic vulnerabilities of deep neural networks. Among the variety of techniques introduced to surmount this inherent weakness, adversarial training has emerged as the most…

机器学习 · 计算机科学 2022-09-14 Matan Levi , Idan Attias , Aryeh Kontorovich

Adversarial training is the most promising method for learning robust models against adversarial examples. A recent study has shown that knowledge distillation between the same architectures is effective in improving the performance of…

机器学习 · 计算机科学 2022-11-02 Tomokatsu Takahashi , Masanori Yamada , Yuuki Yamanaka , Tomoya Yamashita

Adversarial training has been proven to be a powerful regularization method to improve the generalization of models. However, current adversarial training methods only attack the original input sample or the embedding vectors, and their…

机器学习 · 计算机科学 2021-08-31 Shiwen Ni , Jiawen Li , Hung-Yu Kao

Deep neural networks (DNNs) are vulnerable to adversarial examples crafted by well-designed perturbations. This could lead to disastrous results on critical applications such as self-driving cars, surveillance security, and medical…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Yaguan Qian , Chenyu Zhao , Zhaoquan Gu , Bin Wang , Shouling Ji , Wei Wang , Boyang Zhou , Pan Zhou

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

机器学习 · 计算机科学 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding

The recent advances in deep transfer learning reveal that adversarial learning can be embedded into deep networks to learn more transferable features to reduce the distribution discrepancy between two domains. Existing adversarial domain…

机器学习 · 计算机科学 2019-09-19 Chaohui Yu , Jindong Wang , Yiqiang Chen , Meiyu Huang

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in an open-world setting. However, existing OOD detection solutions can be brittle in the open world, facing various types of adversarial OOD…

机器学习 · 计算机科学 2021-07-01 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Xin Zhang , Ying-Cong Chen

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

机器学习 · 计算机科学 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

Remarkable successes were made in Medical Image Classification (MIC) recently, mainly due to wide applications of convolutional neural networks (CNNs). However, adversarial examples (AEs) exhibited imperceptible similarity with raw data,…

图像与视频处理 · 电气工程与系统科学 2024-03-12 Shuai Li , Xiaoguang Ma , Shancheng Jiang , Lu Meng

Recently proposed adversarial training methods show the robustness to both adversarial and original examples and achieve state-of-the-art results in supervised and semi-supervised learning. All the existing adversarial training methods…

机器学习 · 计算机科学 2019-11-15 Shufei Zhang , Kaizhu Huang , Jianke Zhu , Yang Liu

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Haoyue Bai

Data modification, either via additional training datasets, data augmentation, debiasing, and dataset filtering, has been proposed as an effective solution for generalizing to out-of-domain (OOD) inputs, in both natural language processing…

计算与语言 · 计算机科学 2022-03-16 Tejas Gokhale , Swaroop Mishra , Man Luo , Bhavdeep Singh Sachdeva , Chitta Baral

Knowledge distillation is effective for producing small, high-performance neural networks for classification, but these small networks are vulnerable to adversarial attacks. This paper studies how adversarial robustness transfers from…

机器学习 · 计算机科学 2020-07-02 Micah Goldblum , Liam Fowl , Soheil Feizi , Tom Goldstein

The adaptation of large-scale Vision-Language Models (VLMs) through post-training reveals a pronounced generalization gap: models fine-tuned with Reinforcement Learning (RL) consistently achieve superior out-of-distribution (OOD)…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Aojun Lu , Tao Feng , Hangjie Yuan , Wei Li , Yanan Sun

Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Zongyuan Zhang , Qingwen Bu , Tianyang Duan , Zheng Lin , Yuhao Qing , Zihan Fang , Heming Cui , Dong Huang