中文
相关论文

相关论文: Parseval Networks: Improving Robustness to Adversa…

200 篇论文

In this paper, we uniquely study the adversarial robustness of deep neural networks (NN) for classification tasks against that of optimal classifiers. We look at the smallest magnitude of possible additive perturbations that can change a…

机器学习 · 计算机科学 2025-11-05 Jingchao Gao , Ziqing Lu , Raghu Mudumbai , Xiaodong Wu , Jirong Yi , Myung Cho , Catherine Xu , Hui Xie , Weiyu Xu

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

机器学习 · 计算机科学 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong

Neural networks (NNs) have emerged as a state-of-the-art method for modeling nonlinear systems in model predictive control (MPC). However, the robustness of NNs, in terms of sensitivity to small input perturbations, remains a critical…

系统与控制 · 电气工程与系统科学 2023-08-29 Wallace Tan Gian Yion , Zhe Wu

The Lipschitz constant plays a crucial role in certifying the robustness of neural networks to input perturbations. Since calculating the exact Lipschitz constant is NP-hard, efforts have been made to obtain tight upper bounds on the…

机器学习 · 计算机科学 2024-10-30 Yuezhu Xu , S. Sivaranjani

The paper uses statistical and differential geometric motivation to acquire prior information about the learning capability of an artificial neural network on a given dataset. The paper considers a broad class of neural networks with…

机器学习 · 计算机科学 2020-12-02 Ankan Dutta , Arnab Rakshit

Adversarial neural networks solve many important problems in data science, but are notoriously difficult to train. These difficulties come from the fact that optimal weights for adversarial nets correspond to saddle points, and not…

机器学习 · 计算机科学 2018-02-12 Abhay Yadav , Sohil Shah , Zheng Xu , David Jacobs , Tom Goldstein

Since the Lipschitz properties of convolutional neural networks (CNNs) are widely considered to be related to adversarial robustness, we theoretically characterize the $\ell_1$ norm and $\ell_\infty$ norm of 2D multi-channel convolutional…

机器学习 · 计算机科学 2021-08-17 Youwei Liang , Dong Huang

We consider a neural network architecture designed to solve inverse problems where the degradation operator is linear and known. This architecture is constructed by unrolling a forward-backward algorithm derived from the minimization of an…

最优化与控制 · 数学 2025-10-02 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

Adversarial examples reveal critical vulnerabilities in deep neural networks by exploiting their sensitivity to imperceptible input perturbations. While adversarial training remains the predominant defense strategy, it often incurs…

机器学习 · 计算机科学 2025-11-04 Longwei Wang , Ifrat Ikhtear Uddin , KC Santosh , Chaowei Zhang , Xiao Qin , Yang Zhou

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

机器学习 · 计算机科学 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

机器学习 · 统计学 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

The energy landscape of high-dimensional non-convex optimization problems is crucial to understanding the effectiveness of modern deep neural network architectures. Recent works have experimentally shown that two different solutions found…

机器学习 · 计算机科学 2024-03-04 Damien Ferbach , Baptiste Goujaud , Gauthier Gidel , Aymeric Dieuleveut

This paper presents a study of robust policy networks in deep reinforcement learning. We investigate the benefits of policy parameterizations that naturally satisfy constraints on their Lipschitz bound, analyzing their empirical performance…

机器学习 · 计算机科学 2025-02-07 Nicholas H. Barbara , Ruigang Wang , Ian R. Manchester

This work attempts to interpret modern deep (convolutional) networks from the principles of rate reduction and (shift) invariant classification. We show that the basic iterative gradient ascent scheme for optimizing the rate reduction of…

机器学习 · 计算机科学 2020-10-30 Kwan Ho Ryan Chan , Yaodong Yu , Chong You , Haozhi Qi , John Wright , Yi Ma

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

机器学习 · 计算机科学 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

Lipschitz constant is a fundamental property in certified robustness, as smaller values imply robustness to adversarial examples when a model is confident in its prediction. However, identifying the worst-case adversarial examples is known…

机器学习 · 计算机科学 2025-12-16 Yongjin Han , Suhyun Kim

The global Lipschitz constant of a neural network is related to robustness and generalization, yet unlike in many classical models, it is not plainly legible from the parameters. This has motivated sophisticated verification algorithms,…

机器学习 · 计算机科学 2026-05-11 Simon Kuang , Yuezhu Xu , S. Sivaranjani , Xinfan Lin

A crucial property for achieving secure, trustworthy and interpretable deep learning systems is their robustness: small changes to a system's inputs should not result in large changes to its outputs. Mathematically, this means one strives…

机器学习 · 计算机科学 2024-06-04 Bernd Prach , Christoph H. Lampert

Deep residual networks (ResNets) have demonstrated outstanding success in computer vision tasks, attributed to their ability to maintain gradient flow through deep architectures. Simultaneously, controlling the Lipschitz constant in neural…

机器学习 · 计算机科学 2025-12-08 Marius F. R. Juston , Ramavarapu S. Sreenivas , Dustin Nottage , Ahmet Soylemezoglu