中文
相关论文

相关论文: Towards More Robust Interpretation via Local Gradi…

200 篇论文

Deep neural networks (DNNs) have gained prominence in various applications, such as classification, recognition, and prediction, prompting increased scrutiny of their properties. A fundamental attribute of traditional DNNs is their…

机器学习 · 计算机科学 2023-08-15 Roman Garaev , Bader Rasheed , Adil Khan

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

机器学习 · 统计学 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Hessian based measures of flatness, such as the trace, Frobenius and spectral norms, have been argued, used and shown to relate to generalisation. In this paper we demonstrate that for feed forward neural networks under the cross entropy…

机器学习 · 统计学 2020-06-17 Diego Granziol

Current methods for the interpretability of discriminative deep neural networks commonly rely on the model's input-gradients, i.e., the gradients of the output logits w.r.t. the inputs. The common assumption is that these input-gradients…

机器学习 · 计算机科学 2021-03-04 Suraj Srinivas , Francois Fleuret

While modern convolutional neural networks achieve outstanding accuracy on many image classification tasks, they are, compared to humans, much more sensitive to image degradation. Here, we describe a variant of Batch Normalization,…

计算机视觉与模式识别 · 计算机科学 2019-03-05 Bojian Yin , Siebren Schaafsma , Henk Corporaal , H. Steven Scholte , Sander M. Bohte

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

A machine learning model is traditionally considered robust if its prediction remains (almost) constant under input perturbations with small norm. However, real-world tasks like molecular property prediction or point cloud segmentation have…

机器学习 · 计算机科学 2024-01-17 Jan Schuchardt , Yan Scholten , Stephan Günnemann

One popular hypothesis of neural network generalization is that the flat local minima of loss surface in parameter space leads to good generalization. However, we demonstrate that loss surface in parameter space has no obvious relationship…

机器学习 · 计算机科学 2018-10-16 Fuxun Yu , Chenchen Liu , Yanzhi Wang , Liang Zhao , Xiang Chen

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

机器学习 · 计算机科学 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

How to extract more and useful information for single image super resolution is an imperative and difficult problem. Learning-based method is a representative method for such task. However, the results are not so stable as there may exist…

图像与视频处理 · 电气工程与系统科学 2020-03-25 Hu Liang , Shengrong Zhao

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

机器学习 · 计算机科学 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

While neural networks have made significant strides in many AI tasks, they remain vulnerable to a range of noise types, including natural corruptions, adversarial noise, and low-resolution artifacts. Many existing approaches focus on…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Zhiling Zhou , Zirui Liu , Chengming Xu , Yanwei Fu , Xinwei Sun

As object recognition becomes an increasingly common ML task, and recent research demonstrating CNNs vulnerability to attacks and small image perturbations necessitate fully understanding the foundations of object recognition. We focus on…

计算机视觉与模式识别 · 计算机科学 2018-11-01 Megha Srivastava , Kalanit Grill-Spector

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

机器学习 · 计算机科学 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Convolutional neural networks (CNNs) have had great success in many real-world applications and have also been used to model visual processing in the brain. However, these networks are quite brittle - small changes in the input image can…

神经元与认知 · 定量生物学 2018-10-30 Brian Hu , Stefan Mihalas

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

机器学习 · 计算机科学 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

机器学习 · 计算机科学 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

To overcome the restriction of identical distribution assumption, invariant representation learning for unsupervised domain adaptation (UDA) has made significant advances in computer vision and pattern recognition communities. In UDA…

计算机视觉与模式识别 · 计算机科学 2024-07-16 You-Wei Luo , Chuan-Xian Ren , Xiao-Lin Xu , Qingshan Liu

In this work, we present a novel learning-based framework that combines the local accuracy of contrastive learning with the global consistency of geometric approaches, for robust non-rigid matching. We first observe that while contrastive…

计算机视觉与模式识别 · 计算机科学 2022-09-19 Lei Li , Souhaib Attaiki , Maks Ovsjanikov