English
Related papers

Related papers: $\sigma$-zero: Gradient-based Optimization of $\el…

200 papers

Adversarial training is a principled approach for training robust neural networks. Despite of tremendous successes in practice, its theoretical properties still remain largely unexplored. In this paper, we provide new theoretical insights…

Machine Learning · Computer Science 2019-07-29 Yan Li , Ethan X. Fang , Huan Xu , Tuo Zhao

Solving for adversarial examples with projected gradient descent has been demonstrated to be highly effective in fooling the neural network based classifiers. However, in the black-box setting, the attacker is limited only to the query…

Machine Learning · Computer Science 2022-10-19 Seungyong Moon , Gaon An , Hyun Oh Song

In this paper, we investigate the dynamics-aware adversarial attack problem in deep neural networks. Most existing adversarial attack algorithms are designed under a basic assumption -- the network architecture is fixed throughout the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 An Tao , Yueqi Duan , He Wang , Ziyi Wu , Pengliang Ji , Haowen Sun , Jie Zhou , Jiwen Lu

Adversarial robustness is essential for security and reliability of machine learning systems. However, adversarial robustness enhanced by defense algorithms is easily erased as the neural network's weights update to learn new tasks. To…

Machine Learning · Computer Science 2024-08-14 Xiaolei Ru , Xiaowei Cao , Zijia Liu , Jack Murdoch Moore , Xin-Ya Zhang , Xia Zhu , Wenjia Wei , Gang Yan

Deep neural networks are susceptible to small-but-specific adversarial perturbations capable of deceiving the network. This vulnerability can lead to potentially harmful consequences in security-critical applications. To address this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Jasjeet Dhaliwal , Saurabh Shintre

Adversarial machine learning has been both a major concern and a hot topic recently, especially with the ubiquitous use of deep neural networks in the current landscape. Adversarial attacks and defenses are usually likened to a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Ngoc N. Tran , Anh Tuan Bui , Dinh Phung , Trung Le

Neuroevolution automates the complex task of neural network design but often ignores the inherent adversarial fragility of evolved models which is a barrier to adoption in safety-critical scenarios. While robust training methods have…

Neural and Evolutionary Computing · Computer Science 2026-03-27 Inês Valentim , Nuno Antunes , Nuno Lourenço

It is now well understood that $\ell_1$ minimization algorithm is able to recover sparse signals from incomplete measurements [2], [1], [3] and sharp recoverable sparsity thresholds have also been obtained for the $\ell_1$ minimization…

Probability · Mathematics 2009-04-07 Weiyu Xu , M. Amin Khajehnejad , Salman Avestimehr , Babak Hassibi

Deep neural networks have achieved human-level accuracy on almost all perceptual benchmarks. It is interesting that these advances were made using two ideas that are decades old: (a) an artificial neuron based on a linear summator and (b)…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Sergey Bochkanov

Regularization of ill-posed linear inverse problems via $\ell_1$ penalization has been proposed for cases where the solution is known to be (almost) sparse. One way to obtain the minimizer of such an $\ell_1$ penalized functional is via an…

Numerical Analysis · Mathematics 2013-01-01 I. Daubechies , M. Fornasier , I. Loris

Despite much effort, deep neural networks remain highly susceptible to tiny input perturbations and even for MNIST, one of the most common toy datasets in computer vision, no neural network model exists for which adversarial perturbations…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Lukas Schott , Jonas Rauber , Matthias Bethge , Wieland Brendel

Existing segmentation models exhibit significant vulnerability to adversarial attacks.To improve robustness, adversarial training incorporates adversarial examples into model training. However, existing attack methods consider only global…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yufei Song , Ziqi Zhou , Menghao Deng , Yifan Hu , Shengshan Hu , Minghui Li , Leo Yu Zhang

Projected Gradient Descent (PGD) is a strong and widely used first-order adversarial attack, yet its computational cost scales poorly, as all training samples undergo identical iterative inner-loop optimization despite contributing…

Machine Learning · Computer Science 2025-12-29 Youran Ye , Dejin Wang , Ajinkya Bhandare

We study the proximal gradient descent (PGD) method for $\ell^{0}$ sparse approximation problem as well as its accelerated optimization with randomized algorithms in this paper. We first offer theoretical analysis of PGD showing the bounded…

Optimization and Control · Mathematics 2017-09-06 Yingzhen Yang , Jiashi Feng , Nebojsa Jojic , Jianchao Yang , Thomas S. Huang

Dynamic neural networks can greatly reduce computation redundancy without compromising accuracy by adapting their structures based on the input. In this paper, we explore the robustness of dynamic neural networks against energy-oriented…

Cryptography and Security · Computer Science 2023-04-17 Jianhong Pan , Lin Geng Foo , Qichen Zheng , Zhipeng Fan , Hossein Rahmani , Qiuhong Ke , Jun Liu

We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles,…

Machine Learning · Statistics 2018-05-23 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Crafting adversarial examples has become an important technique to evaluate the robustness of deep neural networks (DNNs). However, most existing works focus on attacking the image classification problem since its input space is continuous…

Machine Learning · Computer Science 2020-04-22 Minhao Cheng , Jinfeng Yi , Pin-Yu Chen , Huan Zhang , Cho-Jui Hsieh

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

Machine Learning · Computer Science 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

Evaluating robustness of machine-learning models to adversarial examples is a challenging problem. Many defenses have been shown to provide a false sense of robustness by causing gradient-based attacks to fail, and they have been broken…

Machine Learning · Computer Science 2022-10-12 Maura Pintor , Luca Demetrio , Angelo Sotgiu , Ambra Demontis , Nicholas Carlini , Battista Biggio , Fabio Roli

Randomized classifiers have been shown to provide a promising approach for achieving certified robustness against adversarial attacks in deep learning. However, most existing methods only leverage Gaussian smoothing noise and only work for…

Machine Learning · Computer Science 2020-10-21 Dinghuai Zhang , Mao Ye , Chengyue Gong , Zhanxing Zhu , Qiang Liu