中文
相关论文

相关论文: Achieving Generalizable Robustness of Deep Neural …

200 篇论文

This paper analyzes regularization terms proposed recently for improving the adversarial robustness of deep neural networks (DNNs), from a theoretical point of view. Specifically, we study possible connections between several effective…

机器学习 · 计算机科学 2020-07-07 Yiwen Guo , Long Chen , Yurong Chen , Changshui Zhang

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

机器学习 · 计算机科学 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

In recent years, the widespread use of deep neural networks (DNNs) has facilitated great improvements in performance for computer vision tasks like image classification and object recognition. In most realistic computer vision applications,…

计算机视觉与模式识别 · 计算机科学 2019-08-27 Tejas Borkar , Lina Karam

Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several…

机器学习 · 计算机科学 2021-10-28 Jingyue Lu , M. Pawan Kumar

We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles,…

机器学习 · 统计学 2018-05-23 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on reducing robust overfitting by using common data augmentation schemes. We…

计算机视觉与模式识别 · 计算机科学 2021-11-10 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann

Robustness against adversarial attack in neural networks is an important research topic in the machine learning community. We observe one major source of vulnerability of neural nets is from overparameterized fully-connected layers. In this…

机器学习 · 计算机科学 2021-02-01 Bingyuan Liu , Christopher Malon , Lingzhou Xue , Erik Kruus

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

计算与语言 · 计算机科学 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang

For many real-world applications, obtaining stable and robust statistical performance is more important than simply achieving state-of-the-art predictive test accuracy, and thus robustness of neural networks is an increasingly important…

机器学习 · 计算机科学 2022-05-24 N. Benjamin Erichson , Soon Hoe Lim , Winnie Xu , Francisco Utrera , Ziang Cao , Michael W. Mahoney

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

机器学习 · 计算机科学 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

Over the past decade, Deep Learning has emerged as a useful and efficient tool to solve a wide variety of complex learning problems ranging from image classification to human pose estimation, which is challenging to solve using statistical…

计算机视觉与模式识别 · 计算机科学 2020-05-19 Ashutosh Chaubey , Nikhil Agrawal , Kavya Barnwal , Keerat K. Guliani , Pramod Mehta

For a given stable recurrent neural network (RNN) that is trained to perform a classification task using sequential inputs, we quantify explicit robustness bounds as a function of trainable weight matrices. The sequential inputs can be…

机器学习 · 计算机科学 2022-03-11 Guangyi Liu , Arash Amini , Martin Takac , Nader Motee

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

The robustness of deep neural networks is usually lacking under adversarial examples, common corruptions, and distribution shifts, which becomes an important research problem in the development of deep learning. Although new deep learning…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Chang Liu , Yinpeng Dong , Wenzhao Xiang , Xiao Yang , Hang Su , Jun Zhu , Yuefeng Chen , Yuan He , Hui Xue , Shibao Zheng

Deep learning models operating in the image domain are vulnerable to small input perturbations. For years, robustness to such perturbations was pursued by training models from scratch (i.e., with random initializations) using specialized…

Polynomial regression is a recurrent problem with a large number of applications. In computer vision it often appears in motion analysis. Whatever the application, standard methods for regression of polynomial models tend to deliver biased…

计算机视觉与模式识别 · 计算机科学 2018-05-24 Juan-Manuel Perez-Rua , Tomas Crivelli , Patrick Bouthemy , Patrick Perez

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

机器学习 · 计算机科学 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

机器学习 · 计算机科学 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Modern deep convolutional networks (CNNs) are often criticized for not generalizing under distributional shifts. However, several recent breakthroughs in transfer learning suggest that these networks can cope with severe distribution shifts…

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

机器学习 · 计算机科学 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin