English
Related papers

Related papers: The robust way to stack and bag: the local Lipschi…

200 papers

Deep learning has achieved remarkable success across a wide range of tasks, but its models often suffer from instability and vulnerability: small changes to the input may drastically affect predictions, while optimization can be hindered by…

Machine Learning · Computer Science 2025-10-30 Blaise Delattre

Empirical studies have widely demonstrated that neural networks are highly sensitive to small, adversarial perturbations of the input. The worst-case robustness against these so-called adversarial examples can be quantified by the Lipschitz…

Machine Learning · Statistics 2025-07-03 Paul Geuchen , Dominik Stöger , Thomas Telaar , Felix Voigtlaender

It is a known phenomenon that adversarial robustness comes at a cost to natural accuracy. To improve this trade-off, this paper proposes an ensemble approach that divides a complex robust-classification task into simpler subtasks.…

Machine Learning · Computer Science 2021-06-14 Haifeng Qian

It is desirable, and often a necessity, for machine learning models to be robust against adversarial attacks. This is particularly true for Bayesian models, as they are well-suited for safety-critical applications, in which adversarial…

Machine Learning · Statistics 2021-01-08 Arno Blaas , Stephen J. Roberts

In this work we study input gradient regularization of deep neural networks, and demonstrate that such regularization leads to generalization proofs and improved adversarial robustness. The proof of generalization does not overcome the…

Machine Learning · Computer Science 2019-09-13 Chris Finlay , Jeff Calder , Bilal Abbasi , Adam Oberman

A black-box spectral method is introduced for evaluating the adversarial robustness of a given machine learning (ML) model. Our approach, named SPADE, exploits bijective distance mapping between the input/output graphs constructed for…

Machine Learning · Computer Science 2021-06-15 Wuxinlin Cheng , Chenhui Deng , Zhiqiang Zhao , Yaohui Cai , Zhiru Zhang , Zhuo Feng

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

The Jacobian matrix (or the gradient for single-output networks) is directly related to many important properties of neural networks, such as the function landscape, stationary points, (local) Lipschitz constants and robustness to…

Machine Learning · Statistics 2019-02-28 Huan Zhang , Pengchuan Zhang , Cho-Jui Hsieh

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

Machine Learning · Computer Science 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

The monotonic dependence of the outputs of a neural network on some of its inputs is a crucial inductive bias in many scenarios where domain knowledge dictates such behavior. This is especially important for interpretability and fairness…

Machine Learning · Computer Science 2023-07-17 Ouail Kitouni , Niklas Nolte , Michael Williams

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

The vulnerability of neural networks under adversarial attacks has raised serious concerns and motivated extensive research. It has been shown that both neural networks and adversarial attacks against them can be sensitive to input…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Houpu Yao , Zhe Wang , Guangyu Nie , Yassine Mazboudi , Yezhou Yang , Yi Ren

This work studies the adversarial robustness of parametric functions composed of a linear predictor and a non-linear representation map. % that satisfies certain stability condition. Our analysis relies on \emph{sparse local Lipschitzness}…

Machine Learning · Computer Science 2023-03-07 Ramchandran Muthukumar , Jeremias Sulam

Adversarial robustness has received increasing attention along with the study of adversarial examples. So far, existing works show that robust models not only obtain robustness against various adversarial attacks but also boost the…

Machine Learning · Computer Science 2021-11-29 Yang Bai , Xin Yan , Yong Jiang , Shu-Tao Xia , Yisen Wang

Robustness of neural networks is commonly quantified via local or global Lipschitz constants. However, Lipschitz continuity can be overly coarse or overly restrictive as global robustness measure, failing to capture nuanced, data-dependent…

Machine Learning · Statistics 2026-05-28 Jürgen Dölz , Michael Multerer , Michele Palma

Recent research has shown the vulnerability of Spiking Neural Networks (SNNs) under adversarial examples that are nearly indistinguishable from clean data in the context of frame-based and event-based information. The majority of these…

Machine Learning · Computer Science 2025-09-01 Jiaqi Lin , Abhronil Sengupta

Despite having high accuracy, neural nets have been shown to be susceptible to adversarial examples, where a small perturbation to an input can cause it to become mislabeled. We propose metrics for measuring the robustness of a neural net…

Machine Learning · Computer Science 2017-06-19 Osbert Bastani , Yani Ioannou , Leonidas Lampropoulos , Dimitrios Vytiniotis , Aditya Nori , Antonio Criminisi

Deep Neural Networks (DNNs) have shown substantial success in various applications but remain vulnerable to adversarial attacks. This study aims to identify and isolate the components of two different adversarial training techniques that…

Machine Learning · Computer Science 2025-08-26 William Brooks , Marelie H. Davel , Coenraad Mouton

Lipschitz constants are connected to many properties of neural networks, such as robustness, fairness, and generalization. Existing methods for computing Lipschitz constants either produce relatively loose upper bounds or are limited to…

Machine Learning · Computer Science 2022-10-17 Zhouxing Shi , Yihan Wang , Huan Zhang , Zico Kolter , Cho-Jui Hsieh

Despite significant advances, deep networks remain highly susceptible to adversarial attack. One fundamental challenge is that small input perturbations can often produce large movements in the network's final-layer feature space. In this…

Machine Learning · Computer Science 2023-04-20 Maria-Florina Balcan , Avrim Blum , Dravyansh Sharma , Hongyang Zhang