中文
相关论文

相关论文: Robustness via curvature regularization, and vice …

200 篇论文

The study on improving the robustness of deep neural networks against adversarial examples grows rapidly in recent years. Among them, adversarial training is the most promising one, which flattens the input loss landscape (loss change with…

机器学习 · 计算机科学 2020-10-14 Dongxian Wu , Shu-tao Xia , Yisen Wang

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

机器学习 · 计算机科学 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

Neural networks are getting deeper and more computation-intensive nowadays. Quantization is a useful technique in deploying neural networks on hardware platforms and saving computation costs with negligible performance loss. However, recent…

机器学习 · 计算机科学 2021-01-26 Chang Song , Elias Fallon , Hai Li

Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build more robust models, it…

机器学习 · 计算机科学 2020-06-02 Zheng Xu , Ali Shafahi , Tom Goldstein

Despite their empirical success, neural networks remain vulnerable to small, adversarial perturbations. A longstanding hypothesis suggests that flat minima, regions of low curvature in the loss landscape, offer increased robustness. While…

机器学习 · 计算机科学 2025-10-17 Nils Philipp Walter , Linara Adilova , Jilles Vreeken , Michael Kamp

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

机器学习 · 计算机科学 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao

We connect adversarial training for binary classification to a geometric evolution equation for the decision boundary. Relying on a perspective that recasts adversarial training as a regularization problem, we introduce a modified training…

偏微分方程分析 · 数学 2025-02-03 Leon Bungert , Tim Laux , Kerrek Stinson

Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the…

机器学习 · 计算机科学 2022-03-04 Mo Zhou , Vishal M. Patel

We propose a general framework for increasing local stability of Artificial Neural Nets (ANNs) using Robust Optimization (RO). We achieve this through an alternating minimization-maximization procedure, in which the loss of the network is…

机器学习 · 统计学 2018-05-07 Uri Shaham , Yutaro Yamada , Sahand Negahban

Adversarial training has emerged as a key technique to enhance model robustness against adversarial input perturbations. Many of the existing methods rely on computationally expensive min-max problems that limit their application in…

Adversarial training (i.e., training on adversarially perturbed input data) is a well-studied method for making neural networks robust to potential adversarial attacks during inference. However, the improved robustness does not come for…

机器人学 · 计算机科学 2023-01-27 Mathias Lechner , Alexander Amini , Daniela Rus , Thomas A. Henzinger

Adversarial training (AT) has become the de-facto standard to obtain models robust against adversarial examples. However, AT exhibits severe robust overfitting: cross-entropy loss on adversarial examples, so-called robust loss, decreases…

机器学习 · 计算机科学 2021-10-07 David Stutz , Matthias Hein , Bernt Schiele

It has been shown that neural network classifiers are not robust. This raises concerns about their usage in safety-critical systems. We propose in this paper a regularization scheme for ReLU networks which provably improves the robustness…

机器学习 · 计算机科学 2019-03-11 Francesco Croce , Maksym Andriushchenko , Matthias Hein

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

机器学习 · 计算机科学 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia

Improving the resistance of deep neural networks against adversarial attacks is important for deploying models to realistic applications. However, most defense methods are designed to defend against intensity perturbations and ignore…

机器学习 · 计算机科学 2020-10-07 Pengfei Xia , Bin Li

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

机器学习 · 统计学 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Neural networks are known to be highly sensitive to adversarial examples. These may arise due to different factors, such as random initialization, or spurious correlations in the learning problem. To better understand these factors, we…

机器学习 · 统计学 2022-07-05 Elvis Dohmatob , Alberto Bietti

Reducing the size of neural network models is a critical step in moving AI from a cloud-centric to an edge-centric (i.e. on-device) compute paradigm. This shift from cloud to edge is motivated by a number of factors including reduced…

机器学习 · 计算机科学 2022-01-24 Micah Gorsline , James Smith , Cory Merkel

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

机器学习 · 计算机科学 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

机器学习 · 计算机科学 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani