English
Related papers

Related papers: The robust way to stack and bag: the local Lipschi…

200 papers

Training convolutional neural networks (CNNs) with a strict 1-Lipschitz constraint under the $l_{2}$ norm is useful for adversarial robustness, interpretable gradients and stable training. 1-Lipschitz CNNs are usually designed by enforcing…

Machine Learning · Computer Science 2022-11-17 Sahil Singla , Soheil Feizi

We aim at demonstrating the influence of diversity in the ensemble of CNNs on the detection of black-box adversarial instances and hardening the generation of white-box adversarial attacks. To this end, we propose an ensemble of diverse…

Machine Learning · Computer Science 2020-05-19 Mahdieh Abbasi , Arezoo Rajabi , Christian Gagne , Rakesh B. Bobba

Obtaining sharp Lipschitz constants for feed-forward neural networks is essential to assess their robustness in the face of perturbations of their inputs. We derive such constants in the context of a general layered network model involving…

Optimization and Control · Mathematics 2020-06-23 Patrick L. Combettes , Jean-Christophe Pesquet

In this paper, we analyze the properties of invertible neural networks, which provide a way of solving inverse problems. Our main focus lies on investigating and controlling the Lipschitz constants of the corresponding inverse networks.…

Machine Learning · Computer Science 2021-09-01 Paul Hagemann , Sebastian Neumayer

Deep Learning models hold state-of-the-art performance in many fields, but their vulnerability to adversarial examples poses threat to their ubiquitous deployment in practical settings. Additionally, adversarial inputs generated on one…

Machine Learning · Computer Science 2021-03-31 Deepak Ravikumar , Sangamesh Kodge , Isha Garg , Kaushik Roy

Stochastic neural networks (SNNs) are random functions whose predictions are gained by averaging over multiple realizations. Consequently, a gradient-based adversarial example is calculated based on one set of samples and its classification…

Machine Learning · Computer Science 2023-03-07 Sina Däubener , Asja Fischer

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

Machine Learning · Computer Science 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

We study the adversarial robustness of information bottleneck models for classification. Previous works showed that the robustness of models trained with information bottlenecks can improve upon adversarial training. Our evaluation under a…

Machine Learning · Computer Science 2021-07-14 Iryna Korshunova , David Stutz , Alexander A. Alemi , Olivia Wiles , Sven Gowal

Lipschitz Bound Estimation is an effective method of regularizing deep neural networks to make them robust against adversarial attacks. This is useful in a variety of applications ranging from reinforcement learning to autonomous systems.…

Machine Learning · Computer Science 2022-07-18 Sarosij Bose

Neural networks have gained much interest because of their effectiveness in many applications. However, their mathematical properties are generally not well understood. If there is some underlying geometric structure inherent to the data or…

Machine Learning · Computer Science 2023-09-01 Elena Celledoni , Davide Murari , Brynjulf Owren , Carola-Bibiane Schönlieb , Ferdia Sherry

Computational efficiency and robustness are essential in process modeling, optimization, and control for real-world engineering applications. While neural network-based approaches have gained significant attention in recent years,…

Machine Learning · Computer Science 2026-03-17 Zihao Wang , Yuhan Li , Yao Shi , Zhe Wu

The strategy of ensemble has become popular in adversarial defense, which trains multiple base classifiers to defend against adversarial attacks in a cooperative manner. Despite the empirical success, theoretical explanations on why an…

Machine Learning · Computer Science 2023-11-03 Yian Deng , Tingting Mu

The study of adversarial robustness has so far largely focused on perturbations bound in p-norms. However, state-of-the-art models turn out to be also vulnerable to other, more natural classes of perturbations such as translations and…

Machine Learning · Computer Science 2019-09-17 Logan Engstrom , Brandon Tran , Dimitris Tsipras , Ludwig Schmidt , Aleksander Madry

Ensemble-based adversarial training is a principled approach to achieve robustness against adversarial attacks. An important technique of this approach is to control the transferability of adversarial examples among ensemble members. We…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

In the context of structured nonconvex optimization, we estimate the increase in minimum value for a decision that is robust to parameter perturbations as compared to the value of a nominal problem. The estimates rely on detailed…

Optimization and Control · Mathematics 2022-11-22 Johannes O. Royset

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

Machine Learning · Computer Science 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

Deep neural networks have exhibited impressive performance in image classification tasks but remain vulnerable to adversarial examples. Standard adversarial training enhances robustness but typically fails to explicitly address inter-class…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Himanshu Singh , A. V. Subramanyam , Shivank Rajput , Mohan Kankanhalli

We identify fragile and robust neurons of deep learning architectures using nodal dropouts of the first convolutional layer. Using an adversarial targeting algorithm, we correlate these neurons with the distribution of adversarial attacks…

Machine Learning · Computer Science 2022-02-01 Chandresh Pravin , Ivan Martino , Giuseppe Nicosia , Varun Ojha

Neural networks are vulnerable to adversarial examples and researchers have proposed many heuristic attack and defense mechanisms. We address this problem through the principled lens of distributionally robust optimization, which guarantees…

Machine Learning · Statistics 2020-05-04 Aman Sinha , Hongseok Namkoong , Riccardo Volpi , John Duchi

Neural networks have demonstrated considerable success on a wide variety of real-world problems. However, networks trained only to optimize for training accuracy can often be fooled by adversarial examples - slightly perturbed inputs that…

Machine Learning · Computer Science 2019-02-19 Vincent Tjeng , Kai Xiao , Russ Tedrake