中文
相关论文

相关论文: Enhanced Regularizers for Attributional Robustness

200 篇论文

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

计算机视觉与模式识别 · 计算机科学 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

Because deep neural networks (DNNs) rely on a large number of parameters and computations, their implementation in energy-constrained systems is challenging. In this paper, we investigate the solution of reducing the supply voltage of the…

Although deep learning (DL) has received much attention in accelerated magnetic resonance imaging (MRI), recent studies show that tiny input perturbations may lead to instabilities of DL-based MRI reconstruction models. However, the…

图像与视频处理 · 电气工程与系统科学 2022-11-22 Jinghan Jia , Mingyi Hong , Yimeng Zhang , Mehmet Akçakaya , Sijia Liu

A key challenge that threatens the widespread use of neural networks in safety-critical applications is their vulnerability to adversarial attacks. In this paper, we study the second-order behavior of continuously differentiable deep neural…

机器学习 · 计算机科学 2024-06-10 Taha Entesari , Sina Sharifi , Mahyar Fazlyab

Regularization plays an important role in generalization of deep neural networks, which are often prone to overfitting with their numerous parameters. L1 and L2 regularizers are common regularization tools in machine learning with their…

机器学习 · 计算机科学 2019-10-21 Dae Hoon Park , Chiu Man Ho , Yi Chang , Huaqing Zhang

Deep neural networks for computer vision are deployed in increasingly safety-critical and socially-impactful applications, motivating the need to close the gap in model performance under varied, naturally occurring imaging conditions.…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Nathan Drenkow , Numair Sani , Ilya Shpitser , Mathias Unberath

While deep neural networks can attain good accuracy on in-distribution test points, many applications require robustness even in the face of unexpected perturbations in the input, changes in the domain, or other sources of distribution…

机器学习 · 计算机科学 2022-10-12 Marvin Zhang , Sergey Levine , Chelsea Finn

Deep neural networks have become a standard building block for designing models that can perform multiple dense computer vision tasks such as depth estimation and semantic segmentation thanks to their ability to capture complex correlations…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Wei-Hong Li , Steven McDonagh , Ales Leonardis , Hakan Bilen

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

数值分析 · 数学 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

Regularizing the gradient norm of the output of a neural network with respect to its inputs is a powerful technique, rediscovered several times. This paper presents evidence that gradient regularization can consistently improve…

机器学习 · 计算机科学 2018-05-28 Dániel Varga , Adrián Csiszárik , Zsolt Zombori

The development of the DRL model for malware attribution involved extensive research, iterative coding, and numerous adjustments based on the insights gathered from predecessor models and contemporary research papers. This preparatory work…

密码学与安全 · 计算机科学 2025-01-08 Animesh Singh Basnet , Mohamed Chahine Ghanem , Dipo Dunsin , Wiktor Sowinski-Mydlarz

Bootstrapping is behind much of the successes of deep Reinforcement Learning. However, learning the value function via bootstrapping often leads to unstable training due to fast-changing target values. Target Networks are employed to…

Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Uriya Pesso , Koby Bibas , Meir Feder

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

机器学习 · 计算机科学 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

Despite huge successes on a wide range of tasks, neural networks are known to sometimes struggle to generalise to unseen data. Many approaches have been proposed over the years to promote the generalisation ability of neural networks,…

机器学习 · 计算机科学 2026-02-02 Christiaan P. Opperman , Anna S. Bosman , Katherine M. Malan

Binary representation is desirable for its memory efficiency, computation speed and robustness. In this paper, we propose adjustable bounded rectifiers to learn binary representations for deep neural networks. While hard constraining…

机器学习 · 计算机科学 2015-11-20 Zhirong Wu , Dahua Lin , Xiaoou Tang

Robust fine-tuning aims to achieve competitive in-distribution (ID) performance while maintaining the out-of-distribution (OOD) robustness of a pre-trained model when transferring it to a downstream task. To remedy this, most robust…

机器学习 · 计算机科学 2025-09-09 Xiang Yuan , Jun Shu , Deyu meng , Zongben Xu

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

机器学习 · 计算机科学 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia

Neural networks are powerful function approximators with tremendous potential in learning complex distributions. However, they are prone to overfitting on spurious patterns. Bayesian inference provides a principled way to regularize neural…

机器学习 · 计算机科学 2024-12-02 Yanzhe Bekkemoen , Helge Langseth