中文
相关论文

相关论文: Regularizing deep networks using efficient layerwi…

200 篇论文

Regularizing the input gradient has shown to be effective in promoting the robustness of neural networks. The regularization of the input's Hessian is therefore a natural next step. A key challenge here is the computational complexity.…

机器学习 · 计算机科学 2020-09-15 Waleed Mustafa , Robert A. Vandermeulen , Marius Kloft

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making…

机器学习 · 统计学 2021-11-17 Takeru Miyato , Andrew M. Dai , Ian Goodfellow

There is a growing body of literature showing that deep neural networks are vulnerable to adversarial input modification. Recently this work has been extended from image classification to malware classification over boolean features. In…

机器学习 · 计算机科学 2018-06-26 Alex Kouzemtchenko

Deep neural networks (DNNs) are increasingly being used in a variety of traditional radiofrequency (RF) problems. Previous work has shown that while DNN classifiers are typically more accurate than traditional signal processing algorithms,…

密码学与安全 · 计算机科学 2022-02-24 Roman A. Sandler , Peter K. Relich , Cloud Cho , Sean Holloway

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

机器学习 · 计算机科学 2023-10-05 Matan Levi , Aryeh Kontorovich

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

计算与语言 · 计算机科学 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang

Adversarial noise introduces small perturbations in images, misleading deep learning models into misclassification and significantly impacting recognition accuracy. In this study, we analyzed the effects of Fast Gradient Sign Method (FGSM)…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Manish Kansana , Keyan Alexander Rahimi , Elias Hossain , Iman Dehzangi , Noorbakhsh Amiri Golilarz

Deep neural networks (DNNs) have had many successes, but they suffer from two major issues: (1) a vulnerability to adversarial examples and (2) a tendency to elude human interpretation. Interestingly, recent empirical and theoretical…

机器学习 · 计算机科学 2020-12-07 Adam Noack , Isaac Ahern , Dejing Dou , Boyang Li

In recent years, great progress has been made in a variety of application domains thanks to the development of increasingly deeper neural networks. Unfortunately, the huge number of units of these networks makes them expensive both…

计算机视觉与模式识别 · 计算机科学 2018-10-12 Jose M. Alvarez , Mathieu Salzmann

We demonstrate that the choice of optimizer, neural network architecture, and regularizer significantly affect the adversarial robustness of linear neural networks, providing guarantees without the need for adversarial training. To this…

机器学习 · 计算机科学 2021-06-08 Fartash Faghri , Sven Gowal , Cristina Vasconcelos , David J. Fleet , Fabian Pedregosa , Nicolas Le Roux

Deep neural networks are powerful and popular learning models that achieve state-of-the-art pattern recognition performance on many computer vision, speech, and language processing tasks. However, these networks have also been shown…

机器学习 · 计算机科学 2016-12-20 Nina Narodytska , Shiva Prasad Kasiviswanathan

Deep neural networks (DNNs) are vulnerable to adversarial noise. Preprocessing based defenses could largely remove adversarial noise by processing inputs. However, they are typically affected by the error amplification effect, especially in…

机器学习 · 计算机科学 2021-04-20 Dawei Zhou , Nannan Wang , Chunlei Peng , Xinbo Gao , Xiaoyu Wang , Jun Yu , Tongliang Liu

Deep neural network image classifiers are reported to be susceptible to adversarial evasion attacks, which use carefully crafted images created to mislead a classifier. Recently, various kinds of adversarial attack methods have been…

机器学习 · 计算机科学 2019-10-04 He Zhao , Trung Le , Paul Montague , Olivier De Vel , Tamas Abraham , Dinh Phung

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with…

机器学习 · 计算机科学 2018-12-19 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

In this paper, we introduce a novel regularization method called Adversarial Noise Layer (ANL) and its efficient version called Class Adversarial Noise Layer (CANL), which are able to significantly improve CNN's generalization ability by…

计算机视觉与模式识别 · 计算机科学 2018-10-31 Zhonghui You , Jinmian Ye , Kunming Li , Zenglin Xu , Ping Wang

We focus on the robustness of neural networks for classification. To permit a fair comparison between methods to achieve robustness, we first introduce a standard based on the mensuration of a classifier's degradation. Then, we propose…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Sadaf Gulshad , Arnold Smeulders

For deploying a deep learning model into production, it needs to be both accurate and compact to meet the latency and memory constraints. This usually results in a network that is deep (to ensure performance) and yet thin (to improve…

机器学习 · 计算机科学 2020-08-18 Denny Zhou , Mao Ye , Chen Chen , Tianjian Meng , Mingxing Tan , Xiaodan Song , Quoc Le , Qiang Liu , Dale Schuurmans

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

机器学习 · 计算机科学 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

The rise of deep learning technique has raised new privacy concerns about the training data and test data. In this work, we investigate the model inversion problem in the adversarial settings, where the adversary aims at inferring…

密码学与安全 · 计算机科学 2019-02-25 Ziqi Yang , Ee-Chien Chang , Zhenkai Liang

Pretrained models from self-supervision are prevalently used in fine-tuning downstream tasks faster or for better accuracy. However, gaining robustness from pretraining is left unexplored. We introduce adversarial training into…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Tianlong Chen , Sijia Liu , Shiyu Chang , Yu Cheng , Lisa Amini , Zhangyang Wang