中文
相关论文

相关论文: 1-Lipschitz Layers Compared: Memory, Speed, and Ce…

200 篇论文

Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how architecture design…

计算机视觉与模式识别 · 计算机科学 2022-01-17 Shiyu Tang , Ruihao Gong , Yan Wang , Aishan Liu , Jiakai Wang , Xinyun Chen , Fengwei Yu , Xianglong Liu , Dawn Song , Alan Yuille , Philip H. S. Torr , Dacheng Tao

Recent works have introduced input-convex neural networks (ICNNs) as learning models with advantageous training, inference, and generalization properties linked to their convex structure. In this paper, we propose a novel feature-convex…

机器学习 · 计算机科学 2023-10-11 Samuel Pfrommer , Brendon G. Anderson , Julien Piet , Somayeh Sojoudi

Verifiable training has shown success in creating neural networks that are provably robust to a given amount of noise. However, despite only enforcing a single robustness criterion, its performance scales poorly with dataset complexity. On…

机器学习 · 计算机科学 2020-12-16 Shiqi Wang , Kevin Eykholt , Taesung Lee , Jiyong Jang , Ian Molloy

Designing neural network architectures is a challenging task and knowing which specific layers of a model must be adapted to improve the performance is almost a mystery. In this paper, we introduce a novel theory and metric to identify…

机器学习 · 计算机科学 2020-11-06 David Peer , Sebastian Stabinger , Antonio Rodriguez-Sanchez

Deep neural network (DNN) architecture based models have high expressive power and learning capacity. However, they are essentially a black box method since it is not easy to mathematically formulate the functions that are learned within…

计算机视觉与模式识别 · 计算机科学 2018-03-02 Gaurav Goswami , Nalini Ratha , Akshay Agarwal , Richa Singh , Mayank Vatsa

With the rise of deep neural networks, the challenge of explaining the predictions of these networks has become increasingly recognized. While many methods for explaining the decisions of deep neural networks exist, there is currently no…

机器学习 · 计算机科学 2022-07-13 Ian E. Nielsen , Dimah Dera , Ghulam Rasool , Nidhal Bouaynaya , Ravi P. Ramachandran

Abstracting neural networks with constraints they impose on their inputs and outputs can be very useful in the analysis of neural network classifiers and to derive optimization-based algorithms for certification of stability and robustness…

机器学习 · 计算机科学 2021-05-04 Navid Hashemi , Justin Ruths , Mahyar Fazlyab

Verifying robustness of neural network classifiers has attracted great interests and attention due to the success of deep neural networks and their unexpected vulnerability to adversarial perturbations. Although finding minimum adversarial…

机器学习 · 统计学 2018-11-30 Akhilan Boopathy , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Recent work has shown that state-of-the-art classifiers are quite brittle, in the sense that a small adversarial change of an originally with high confidence correctly classified input leads to a wrong classification again with high…

机器学习 · 计算机科学 2017-11-07 Matthias Hein , Maksym Andriushchenko

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

机器学习 · 计算机科学 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

This paper proposes Characteristic Examples for effectively fingerprinting deep neural networks, featuring high-robustness to the base model against model pruning as well as low-transferability to unassociated models. This is the first work…

机器学习 · 计算机科学 2021-05-18 Siyue Wang , Xiao Wang , Pin-Yu Chen , Pu Zhao , Xue Lin

Deep Neural Networks (DNNs) are vulnerable to adversarial attacks. Existing methods are devoted to developing various robust training strategies or regularizations to update the weights of the neural network. But beyond the weights, the…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Minjing Dong , Yanxi Li , Yunhe Wang , Chang Xu

Recent studies show that training deep neural networks (DNNs) with Lipschitz constraints are able to enhance adversarial robustness and other model properties such as stability. In this paper, we propose a layer-wise orthogonal training…

机器学习 · 计算机科学 2023-03-28 Xiaojun Xu , Linyi Li , Bo Li

Adversarial examples can easily degrade the classification performance in neural networks. Empirical methods for promoting robustness to such examples have been proposed, but often lack both analytical insights and formal guarantees.…

机器学习 · 计算机科学 2022-02-15 Bernardo Aquino , Arash Rahnama , Peter Seiler , Lizhen Lin , Vijay Gupta

Tight estimation of the Lipschitz constant for deep neural networks (DNNs) is useful in many applications ranging from robustness certification of classifiers to stability analysis of closed-loop systems with reinforcement learning…

机器学习 · 计算机科学 2023-01-18 Mahyar Fazlyab , Alexander Robey , Hamed Hassani , Manfred Morari , George J. Pappas

How can we make machine learning provably robust against adversarial examples in a scalable way? Since certified defense methods, which ensure $\epsilon$-robust, consume huge resources, they can only achieve small degree of robustness in…

机器学习 · 计算机科学 2018-11-21 Hajime Ono , Tsubasa Takahashi , Kazuya Kakizaki

Training convolutional neural networks (CNNs) with a strict Lipschitz constraint under the $l_{2}$ norm is useful for provable adversarial robustness, interpretable gradients and stable training. While $1$-Lipschitz CNNs can be designed by…

机器学习 · 计算机科学 2022-03-29 Sahil Singla , Surbhi Singla , Soheil Feizi

We propose a neural network architecture that can learn discriminative geometric representations of data from persistence diagrams, common descriptors of Topological Data Analysis. The learned representations enjoy Lipschitz stability with…

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Reinforcement learning (RL) policies deployed in real-world environments must remain reliable under adversarial perturbations. At the same time, modern deep RL agents are heavily over-parameterized, raising costs and fragility concerns.…

机器学习 · 计算机科学 2025-10-16 James Pedley , Benjamin Etheridge , Stephen J. Roberts , Francesco Quinzan