English
Related papers

Related papers: The robust way to stack and bag: the local Lipschi…

200 papers

We introduce a neural network architecture to solve inverse problems linked to a one-dimensional integral operator. This architecture is built by unfolding a forward-backward algorithm derived from the minimization of an objective function…

Optimization and Control · Mathematics 2021-06-01 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

We propose a neural network architecture that can learn discriminative geometric representations of data from persistence diagrams, common descriptors of Topological Data Analysis. The learned representations enjoy Lipschitz stability with…

It is becoming increasingly clear that many machine learning classifiers are vulnerable to adversarial examples. In attempting to explain the origin of adversarial examples, previous studies have typically focused on the fact that neural…

Machine Learning · Statistics 2017-11-09 Ekin D. Cubuk , Barret Zoph , Samuel S. Schoenholz , Quoc V. Le

To defend deep neural networks from adversarial attacks, adversarial training has been drawing increasing attention for its effectiveness. However, the accuracy and robustness resulting from the adversarial training are limited by the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yuwei Ou , Yuqi Feng , Yanan Sun

Adversarial examples can easily degrade the classification performance in neural networks. Empirical methods for promoting robustness to such examples have been proposed, but often lack both analytical insights and formal guarantees.…

Machine Learning · Computer Science 2022-02-15 Bernardo Aquino , Arash Rahnama , Peter Seiler , Lizhen Lin , Vijay Gupta

High sensitivity of neural networks against malicious perturbations on inputs causes security concerns. To take a steady step towards robust classifiers, we aim to create neural network models provably defended from perturbations. Prior…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Yusuke Tsuzuku , Issei Sato , Masashi Sugiyama

The local Lipschitz constant of a neural network is a useful metric with applications in robustness, generalization, and fairness evaluation. We provide novel analytic results relating the local Lipschitz constant of nonsmooth vector-valued…

Machine Learning · Statistics 2021-01-12 Matt Jordan , Alexandros G. Dimakis

Recent research has revealed that high compression of Deep Neural Networks (DNNs), e.g., massive pruning of the weight matrix of a DNN, leads to a severe drop in accuracy and susceptibility to adversarial attacks. Integration of network…

Machine Learning · Computer Science 2025-03-27 Yangqi Feng , Shing-Ho J. Lin , Baoyuan Gao , Xian Wei

We introduce LiPopt, a polynomial optimization framework for computing increasingly tighter upper bounds on the Lipschitz constant of neural networks. The underlying optimization problems boil down to either linear (LP) or semidefinite…

Machine Learning · Computer Science 2020-04-21 Fabian Latorre , Paul Rolland , Volkan Cevher

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

Deep neural networks are powerful, but they also have shortcomings such as their sensitivity to adversarial examples, noise, blur, occlusion, etc. Moreover, ensuring the reliability and robustness of deep neural network models is crucial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

This paper proposes an attack-independent (non-adversarial training) technique for improving adversarial robustness of neural network models, with minimal loss of standard accuracy. We suggest creating a neighborhood around each training…

Machine Learning · Computer Science 2021-07-28 Bronya Roni Chernyak , Bhiksha Raj , Tamir Hazan , Joseph Keshet

In deep learning applications, the architectures of deep neural networks are crucial in achieving high accuracy. Many methods have been proposed to search for high-performance neural architectures automatically. However, these searched…

Machine Learning · Computer Science 2020-12-14 Ramtin Hosseini , Xingyi Yang , Pengtao Xie

We present a new algorithm to train a robust neural network against adversarial attacks. Our algorithm is motivated by the following two ideas. First, although recent work has demonstrated that fusing randomness can improve the robustness…

Machine Learning · Computer Science 2019-05-07 Xuanqing Liu , Yao Li , Chongruo Wu , Cho-Jui Hsieh

We explore methodologies to improve the robustness of generative adversarial imitation learning (GAIL) algorithms to observation noise. Towards this objective, we study the effect of local Lipschitzness of the discriminator and the…

Machine Learning · Computer Science 2024-01-17 Farzan Memarian , Abolfazl Hashemi , Scott Niekum , Ufuk Topcu

We study Label-Smoothing as a means for improving adversarial robustness of supervised deep-learning models. After establishing a thorough and unified framework, we propose several variations to this general method: adversarial, Boltzmann…

Machine Learning · Computer Science 2019-10-16 Morgane Goibert , Elvis Dohmatob

Our research aims to unify existing works' diverging opinions on how architectural components affect the adversarial robustness of CNNs. To accomplish our goal, we synthesize a suite of three generalizable robust architectural design…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 ShengYun Peng , Weilin Xu , Cory Cornelius , Matthew Hull , Kevin Li , Rahul Duggal , Mansi Phute , Jason Martin , Duen Horng Chau

This paper investigates the theory of robustness against adversarial attacks. It focuses on the family of randomization techniques that consist in injecting noise in the network at inference time. These techniques have proven effective in…

Machine Learning · Computer Science 2019-06-12 Rafael Pinot , Laurent Meunier , Alexandre Araujo , Hisashi Kashima , Florian Yger , Cédric Gouy-Pailler , Jamal Atif

Ensembles of neural networks achieve superior performance compared to stand-alone networks in terms of accuracy, uncertainty calibration and robustness to dataset shift. \emph{Deep ensembles}, a state-of-the-art method for uncertainty…

Machine Learning · Computer Science 2022-02-23 Sheheryar Zaidi , Arber Zela , Thomas Elsken , Chris Holmes , Frank Hutter , Yee Whye Teh
‹ Prev 1 3 4 5 6 7 10 Next ›