English
Related papers

Related papers: A Recipe for Improved Certifiable Robustness

200 papers

We present knowledge continuity, a novel definition inspired by Lipschitz continuity which aims to certify the robustness of neural networks across input domains (such as continuous and discrete domains in vision and language,…

Machine Learning · Computer Science 2024-11-05 Alan Sun , Chiyu Ma , Kenneth Ge , Soroush Vosoughi

Abstracting neural networks with constraints they impose on their inputs and outputs can be very useful in the analysis of neural network classifiers and to derive optimization-based algorithms for certification of stability and robustness…

Machine Learning · Computer Science 2021-05-04 Navid Hashemi , Justin Ruths , Mahyar Fazlyab

Ensuring neural network robustness is essential for the safe and reliable operation of robotic learning systems, especially in perception and decision-making tasks within real-world environments. This paper investigates the robustness of…

Machine Learning · Computer Science 2024-11-01 Abulikemu Abuduweili , Changliu Liu

Deep Reinforcement Learning (DRL) has achieved remarkable advances in sequential decision tasks. However, recent works have revealed that DRL agents are susceptible to slight perturbations in observations. This vulnerability raises concerns…

Machine Learning · Computer Science 2023-12-15 Buqing Nie , Jingtian Ji , Yangqing Fu , Yue Gao

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

Wasserstein distributionally robust optimization (WDRO) provides a framework for adversarial robustness, yet existing methods based on global Lipschitz continuity or strong duality often yield loose upper bounds or require prohibitive…

Machine Learning · Computer Science 2026-02-04 Bach C. Le , Tung V. Dao , Binh T. Nguyen , Hong T. M. Chu

The neural network with $1$-Lipschitz property based on $\ell_\infty$-dist neuron has a theoretical guarantee in certified $\ell_\infty$ robustness. However, due to the inherent difficulties in the training of the network, the certified…

Machine Learning · Computer Science 2021-07-02 Binghui Li , Shiji Xin , Qizhe Zhang

Sensitivity-based robustness certification has emerged as a practical approach for certifying neural network robustness, including in settings that require verifiable guarantees. A key advantage of these methods is that certification is…

Machine Learning · Computer Science 2026-03-26 Toby Murray

Robustness of deep neural networks against adversarial perturbations is a pressing concern motivated by recent findings showing the pervasive nature of such vulnerabilities. One method of characterizing the robustness of a neural network…

Machine Learning · Statistics 2021-03-15 Hisham Husain , Borja Balle

A robustness certificate is the minimum distance of a given input to the decision boundary of the classifier (or its lower bound). For {\it any} input perturbations with a magnitude smaller than the certificate value, the classification…

Machine Learning · Computer Science 2020-06-02 Sahil Singla , Soheil Feizi

Lipschitz Bound Estimation is an effective method of regularizing deep neural networks to make them robust against adversarial attacks. This is useful in a variety of applications ranging from reinforcement learning to autonomous systems.…

Machine Learning · Computer Science 2022-07-18 Sarosij Bose

Randomized smoothing is the state-of-the-art approach to construct image classifiers that are provably robust against additive adversarial perturbations of bounded magnitude. However, it is more complicated to construct reasonable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Dmitrii Korzh , Mikhail Pautov , Olga Tsymboi , Ivan Oseledets

Deriving tight Lipschitz bounds for transformer-based architectures presents a significant challenge. The large input sizes and high-dimensional attention modules typically prove to be crucial bottlenecks during the training process and…

Machine Learning · Computer Science 2025-03-20 Rohan Menon , Nicola Franco , Stephan Günnemann

The robustness of neural networks to adversarial examples has received great attention due to security implications. Despite various attack approaches to crafting visually imperceptible adversarial examples, little has been developed…

Machine Learning · Statistics 2018-02-01 Tsui-Wei Weng , Huan Zhang , Pin-Yu Chen , Jinfeng Yi , Dong Su , Yupeng Gao , Cho-Jui Hsieh , Luca Daniel

Relying on the premise that the performance of a binary neural network can be largely restored with eliminated quantization error between full-precision weight vectors and their corresponding binary vectors, existing works of network…

Machine Learning · Computer Science 2022-07-19 Yuzhang Shang , Dan Xu , Bin Duan , Ziliang Zong , Liqiang Nie , Yan Yan

Adversarial examples can easily degrade the classification performance in neural networks. Empirical methods for promoting robustness to such examples have been proposed, but often lack both analytical insights and formal guarantees.…

Machine Learning · Computer Science 2022-02-15 Bernardo Aquino , Arash Rahnama , Peter Seiler , Lizhen Lin , Vijay Gupta

Robustness certification against bounded input noise or adversarial perturbations is increasingly important for deployment recurrent neural networks (RNNs) in safety-critical control applications. To address this challenge, we present…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Paul Hamelbeck , Johannes Schiffer

Robust risk minimisation has several advantages: it has been studied with regards to improving the generalisation properties of models and robustness to adversarial perturbation. We bound the distributionally robust risk for a model class…

Machine Learning · Statistics 2018-09-06 Zac Cranko , Simon Kornblith , Zhan Shi , Richard Nock

This paper proposes a theoretical and computational framework for training and robustness verification of implicit neural networks based upon non-Euclidean contraction theory. The basic idea is to cast the robustness analysis of a neural…

Machine Learning · Computer Science 2022-08-09 Saber Jafarpour , Alexander Davydov , Matthew Abate , Francesco Bullo , Samuel Coogan

Recent works have introduced input-convex neural networks (ICNNs) as learning models with advantageous training, inference, and generalization properties linked to their convex structure. In this paper, we propose a novel feature-convex…

Machine Learning · Computer Science 2023-10-11 Samuel Pfrommer , Brendon G. Anderson , Julien Piet , Somayeh Sojoudi