中文
相关论文

相关论文: Improved deterministic l2 robustness on CIFAR-10 a…

200 篇论文

Training convolutional neural networks (CNNs) with a strict 1-Lipschitz constraint under the $l_{2}$ norm is useful for adversarial robustness, interpretable gradients and stable training. 1-Lipschitz CNNs are usually designed by enforcing…

机器学习 · 计算机科学 2022-11-17 Sahil Singla , Soheil Feizi

Training convolutional neural networks with a Lipschitz constraint under the $l_{2}$ norm is useful for provable adversarial robustness, interpretable gradients, stable training, etc. While 1-Lipschitz networks can be designed by imposing a…

机器学习 · 计算机科学 2021-06-15 Sahil Singla , Soheil Feizi

We establish a layer-wise parameterization for 1D convolutional neural networks (CNNs) with built-in end-to-end robustness guarantees. In doing so, we use the Lipschitz constant of the input-output mapping characterized by a CNN as a…

机器学习 · 计算机科学 2024-01-26 Patricia Pauli , Ruigang Wang , Ian R. Manchester , Frank Allgöwer

Since the Lipschitz properties of convolutional neural networks (CNNs) are widely considered to be related to adversarial robustness, we theoretically characterize the $\ell_1$ norm and $\ell_\infty$ norm of 2D multi-channel convolutional…

机器学习 · 计算机科学 2021-08-17 Youwei Liang , Dong Huang

Recent studies show that training deep neural networks (DNNs) with Lipschitz constraints are able to enhance adversarial robustness and other model properties such as stability. In this paper, we propose a layer-wise orthogonal training…

机器学习 · 计算机科学 2023-03-28 Xiaojun Xu , Linyi Li , Bo Li

Lipschitz Bound Estimation is an effective method of regularizing deep neural networks to make them robust against adversarial attacks. This is useful in a variety of applications ranging from reinforcement learning to autonomous systems.…

机器学习 · 计算机科学 2022-07-18 Sarosij Bose

Despite the promise of Lipschitz-based methods for provably-robust deep learning with deterministic guarantees, current state-of-the-art results are limited to feed-forward Convolutional Networks (ConvNets) on low-dimensional data, such as…

机器学习 · 计算机科学 2023-10-31 Kai Hu , Andy Zou , Zifan Wang , Klas Leino , Matt Fredrikson

Lipschitz constant is a fundamental property in certified robustness, as smaller values imply robustness to adversarial examples when a model is confident in its prediction. However, identifying the worst-case adversarial examples is known…

机器学习 · 计算机科学 2025-12-16 Yongjin Han , Suhyun Kim

Neural networks (NNs) have emerged as a state-of-the-art method for modeling nonlinear systems in model predictive control (MPC). However, the robustness of NNs, in terms of sensitivity to small input perturbations, remains a critical…

系统与控制 · 电气工程与系统科学 2023-08-29 Wallace Tan Gian Yion , Zhe Wu

We introduce Parseval networks, a form of deep neural networks in which the Lipschitz constant of linear, convolutional and aggregation layers is constrained to be smaller than 1. Parseval networks are empirically and theoretically…

机器学习 · 统计学 2017-08-08 Moustapha Cisse , Piotr Bojanowski , Edouard Grave , Yann Dauphin , Nicolas Usunier

This paper proposes a class of well-conditioned neural networks in which a unit amount of change in the inputs causes at most a unit amount of change in the outputs or any of the internal layers. We develop the known methodology of…

人工智能 · 计算机科学 2019-02-07 Haifeng Qian , Mark N. Wegman

We propose a novel layer-wise parameterization for convolutional neural networks (CNNs) that includes built-in robustness guarantees by enforcing a prescribed Lipschitz bound. Each layer in our parameterization is designed to satisfy a…

机器学习 · 计算机科学 2026-04-10 Patricia Pauli , Ruigang Wang , Ian Manchester , Frank Allgöwer

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map…

机器学习 · 计算机科学 2021-04-30 Patricia Pauli , Anne Koch , Julian Berberich , Paul Kohler , Frank Allgöwer

Certified robustness is a desirable property for deep neural networks in safety-critical applications, and popular training algorithms can certify robustness of a neural network by computing a global bound on its Lipschitz constant.…

机器学习 · 计算机科学 2021-11-03 Yujia Huang , Huan Zhang , Yuanyuan Shi , J Zico Kolter , Anima Anandkumar

High sensitivity of neural networks against malicious perturbations on inputs causes security concerns. To take a steady step towards robust classifiers, we aim to create neural network models provably defended from perturbations. Prior…

计算机视觉与模式识别 · 计算机科学 2018-11-02 Yusuke Tsuzuku , Issei Sato , Masashi Sugiyama

Lipschitz constraints under L2 norm on deep neural networks are useful for provable adversarial robustness bounds, stable training, and Wasserstein distance estimation. While heuristic approaches such as the gradient penalty have seen much…

机器学习 · 计算机科学 2019-11-12 Qiyang Li , Saminul Haque , Cem Anil , James Lucas , Roger Grosse , Jörn-Henrik Jacobsen

Recently, Zhang et al. (2021) developed a new neural network architecture based on $\ell_\infty$-distance functions, which naturally possesses certified $\ell_\infty$ robustness by its construction. Despite the novel design and theoretical…

机器学习 · 计算机科学 2022-03-16 Bohang Zhang , Du Jiang , Di He , Liwei Wang

Lipschitz constrained networks have gathered considerable attention in the deep learning community, with usages ranging from Wasserstein distance estimation to the training of certifiably robust classifiers. However they remain commonly…

The robustness of neural networks against input perturbations with bounded magnitude represents a serious concern in the deployment of deep learning models in safety-critical systems. Recently, the scientific community has focused on…

机器学习 · 计算机科学 2023-11-29 Bernd Prach , Fabio Brau , Giorgio Buttazzo , Christoph H. Lampert

One of the challenges in the study of Generative Adversarial Networks (GANs) is the difficulty of its performance control. Lipschitz constraint is essential in guaranteeing training stability for GANs. Although heuristic methods such as…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Kanglin Liu , Guoping Qiu
‹ 上一页 1 2 3 10 下一页 ›