中文
相关论文

相关论文: Expected Tight Bounds for Robust Training

200 篇论文

A robustness certificate is the minimum distance of a given input to the decision boundary of the classifier (or its lower bound). For {\it any} input perturbations with a magnitude smaller than the certificate value, the classification…

机器学习 · 计算机科学 2020-06-02 Sahil Singla , Soheil Feizi

Imposing constraints on the output of a Deep Neural Net is one way to improve the quality of its predictions while loosening the requirements for labeled training data. Such constraints are usually imposed as soft constraints by adding new…

计算机视觉与模式识别 · 计算机科学 2017-06-08 Pablo Márquez-Neila , Mathieu Salzmann , Pascal Fua

Binary Neural Networks (BNNs), which constrain both weights and activations to binary values, offer substantial reductions in computational complexity, memory footprint, and energy consumption. These advantages make them particularly well…

机器学习 · 计算机科学 2026-02-18 Luca Colombo , Fabrizio Pittorino , Daniele Zambon , Carlo Baldassi , Manuel Roveri , Cesare Alippi

Defenses against adversarial examples, such as adversarial training, are typically tailored to a single perturbation type (e.g., small $\ell_\infty$-noise). For other perturbations, these defenses offer no guarantees and, at times, even…

机器学习 · 计算机科学 2019-10-21 Florian Tramèr , Dan Boneh

Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to…

机器学习 · 计算机科学 2020-10-23 Akhilan Boopathy , Sijia Liu , Gaoyuan Zhang , Cynthia Liu , Pin-Yu Chen , Shiyu Chang , Luca Daniel

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

机器学习 · 计算机科学 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

Verifying the robustness of machine learning models against evasion attacks at test time is an important research problem. Unfortunately, prior work established that this problem is NP-hard for decision tree ensembles, hence bound to be…

机器学习 · 计算机科学 2023-11-14 Stefano Calzavara , Lorenzo Cazzaro , Giulio Ermanno Pibiri , Nicola Prezza

Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build more robust models, it…

机器学习 · 计算机科学 2020-06-02 Zheng Xu , Ali Shafahi , Tom Goldstein

Adversarial training is arguably the most popular way to provide empirical robustness against specific adversarial examples. While variants based on multi-step attacks incur significant computational overhead, single-step variants are…

机器学习 · 计算机科学 2025-03-25 Alessandro De Palma , Serge Durand , Zakaria Chihani , François Terrier , Caterina Urban

We investigate the robustness of sparse artificial neural networks trained with adaptive topology. We focus on a simple yet effective architecture consisting of three sparse layers with 99% sparsity followed by a dense layer, applied to…

机器学习 · 计算机科学 2026-02-26 Bendegúz Sulyok , Gergely Palla , Filippo Radicchi , Santo Fortunato

In this paper we explore the relation between distributionally robust learning and different forms of regularization to enforce robustness of deep neural networks. In particular, starting from a concrete min-max distributionally robust…

最优化与控制 · 数学 2022-03-29 Camilo Garcia Trillos , Nicolas Garcia Trillos

The adversarial vulnerability of deep neural networks (DNNs) has been actively investigated in the past several years. This paper investigates the scale-variant property of cross-entropy loss, which is the most commonly used loss function…

机器学习 · 计算机科学 2022-10-12 Ziquan Liu , Antoni B. Chan

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

机器学习 · 计算机科学 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

机器学习 · 计算机科学 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training is a standard defense against malicious input perturbations in security-critical machine-learning systems. Its main burden is structural: before every parameter update, the current model must first be attacked to find a…

量子物理 · 物理学 2026-03-31 Yue Wang , Guangyi He , Liepeng Zhang , Lukas Gonon , Qi Zhao

As humans, we inherently perceive images based on their predominant features, and ignore noise embedded within lower bit planes. On the contrary, Deep Neural Networks are known to confidently misclassify images corrupted with meticulously…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Sravanti Addepalli , Vivek B. S. , Arya Baburaj , Gaurang Sriramanan , R. Venkatesh Babu

Fine-tuned large language models (LLMs) often exhibit overconfidence, particularly when trained on small datasets, resulting in poor calibration and inaccurate uncertainty estimates. Evidential Deep Learning (EDL), an uncertainty-aware…

机器学习 · 计算机科学 2025-02-12 Yawei Li , David Rügamer , Bernd Bischl , Mina Rezaei

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

计算机视觉与模式识别 · 计算机科学 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

Deep networks are able to learn highly predictive models of video data. Due to video length, a common strategy is to train them on small video snippets. We apply the deep Taylor / LRP technique to understand the deep network's…

机器学习 · 计算机科学 2018-06-20 Christopher Anders , Grégoire Montavon , Wojciech Samek , Klaus-Robert Müller

Deep Neural Networks (DNNs) are often criticized for being susceptible to adversarial attacks. Most successful defense strategies adopt adversarial training or random input transformations that typically require retraining or fine-tuning…

计算机视觉与模式识别 · 计算机科学 2021-11-25 Lokender Tiwari , Anish Madan , Saket Anand , Subhashis Banerjee