中文
相关论文

相关论文: Pruning Adversarially Robust Neural Networks witho…

200 篇论文

Adversarial training and its variants have become de facto standards for learning robust deep neural networks. In this paper, we explore the landscape around adversarial training in a bid to uncover its limits. We systematically study the…

机器学习 · 统计学 2021-03-31 Sven Gowal , Chongli Qin , Jonathan Uesato , Timothy Mann , Pushmeet Kohli

Deep neural network-based image compression (NIC) has achieved excellent performance, but NIC method models have been shown to be susceptible to backdoor attacks. Adversarial training has been validated in image compression models as a…

图像与视频处理 · 电气工程与系统科学 2024-03-19 Zhi Cao , Youneng Bao , Fanyang Meng , Chao Li , Wen Tan , Genhong Wang , Yongsheng Liang

The prevalence and success of Deep Neural Network (DNN) applications in recent years have motivated research on DNN compression, such as pruning and quantization. These techniques accelerate model inference, reduce power consumption, and…

机器学习 · 计算机科学 2022-06-16 Jonah O'Brien Weiss , Tiago Alves , Sandip Kundu

In practice, deep neural networks have been found to be vulnerable to various types of noise, such as adversarial examples and corruption. Various adversarial defense methods have accordingly been developed to improve adversarial robustness…

机器学习 · 计算机科学 2020-12-24 Aishan Liu , Xianglong Liu , Chongzhi Zhang , Hang Yu , Qiang Liu , Dacheng Tao

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

机器学习 · 计算机科学 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos

Adversarial training is an effective methodology for training deep neural networks that are robust against adversarial, norm-bounded perturbations. However, the computational cost of adversarial training grows prohibitively as the size of…

This paper presents an iterative pruning strategy for Convolutional Network Fabrics (CNF) in presence of noisy training and testing data. With the continuous increase in size of neural network models, various authors have developed pruning…

机器学习 · 计算机科学 2022-02-16 Ilias Benjelloun , Bart Lamiroy , Efoevi Koudou

Deep Reinforcement Learning (RL) is a powerful framework for solving complex real-world problems. Large neural networks employed in the framework are traditionally associated with better generalization capabilities, but their increased size…

机器学习 · 计算机科学 2022-01-03 Samin Yeasar Arnob , Riyasat Ohib , Sergey Plis , Doina Precup

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

机器学习 · 计算机科学 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Adversarial training is a defense technique that improves adversarial robustness of a deep neural network (DNN) by including adversarial examples in the training data. In this paper, we identify an overlooked problem of adversarial training…

机器学习 · 计算机科学 2020-09-24 Wonseok Lee , Hanbit Lee , Sang-goo Lee

Current neural-network-based classifiers are susceptible to adversarial examples. The most empirically successful approach to defending against such adversarial examples is adversarial training, which incorporates a strong self-attack…

机器学习 · 计算机科学 2020-06-08 Bai Li , Shiqi Wang , Suman Jana , Lawrence Carin

Convolutional neural networks (CNNs) excel in computer vision but are susceptible to adversarial attacks, crafted perturbations designed to mislead predictions. Despite advances in adversarial training, a gap persists between model accuracy…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Hayat Ullah , Syed Muhammad Talha Zaidi , Arslan Munir

Adversarial training can improve the robustness of neural networks. Previous methods focus on a single adversarial training strategy and do not consider the model property trained by different strategies. By revisiting the previous methods,…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Xingbin Liu , Huafeng Kuang , Xianming Lin , Yongjian Wu , Rongrong Ji

Recently, neural network compression schemes like channel pruning have been widely used to reduce the model size and computational complexity of deep neural network (DNN) for applications in power-constrained scenarios such as embedded…

机器学习 · 计算机科学 2021-07-20 Jiandong Mu , Mengdi Wang , Feiwen Zhu , Jun Yang , Wei Lin , Wei Zhang

The vulnerability of neural networks under adversarial attacks has raised serious concerns and motivated extensive research. It has been shown that both neural networks and adversarial attacks against them can be sensitive to input…

计算机视觉与模式识别 · 计算机科学 2019-06-17 Houpu Yao , Zhe Wang , Guangyu Nie , Yassine Mazboudi , Yezhou Yang , Yi Ren

Several techniques for domain adaptation have been proposed to account for differences in the distribution of the data used for training and testing. The majority of this work focuses on a binary domain label. Similar problems occur in a…

机器学习 · 统计学 2020-02-18 Gilles Louppe , Michael Kagan , Kyle Cranmer

In this work we present a method to improve the pruning step of the current state-of-the-art methodology to compress neural networks. The novelty of the proposed pruning technique is in its differentiability, which allows pruning to be…

计算机视觉与模式识别 · 计算机科学 2019-01-08 Franco Manessi , Alessandro Rozza , Simone Bianco , Paolo Napoletano , Raimondo Schettini

Neural network pruning is a popular technique used to reduce the inference costs of modern, potentially overparameterized, networks. Starting from a pre-trained network, the process is as follows: remove redundant parameters, retrain, and…

机器学习 · 计算机科学 2021-03-05 Lucas Liebenwein , Cenk Baykal , Brandon Carter , David Gifford , Daniela Rus

Deep learning models are intrinsically sensitive to distribution shifts in the input data. In particular, small, barely perceivable perturbations to the input data can force models to make wrong predictions with high confidence. An common…

计算机视觉与模式识别 · 计算机科学 2022-10-26 Paul Gavrikov , Janis Keuper

Convolutional Neural Networks (CNNs) are hard to deploy on edge devices due to its high computation and storage complexities. As a common practice for model compression, network pruning consists of two major categories: unstructured and…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Yuchuan Tian , Hanting Chen , Tianyu Guo , Chao Xu , Yunhe Wang