English
Related papers

Related papers: Optimization for Robustness Evaluation beyond $\el…

200 papers

Empirical robustness evaluation (RE) of deep learning models against adversarial perturbations entails solving nontrivial constrained optimization problems. Existing numerical algorithms that are commonly used to solve them in practice…

Machine Learning · Computer Science 2023-03-24 Hengyue Liang , Buyun Liang , Le Peng , Ying Cui , Tim Mitchell , Ju Sun

Owing to the susceptibility of deep learning systems to adversarial attacks, there has been a great deal of work in developing (both empirically and certifiably) robust classifiers. While most work has defended against a single type of…

Machine Learning · Computer Science 2020-07-30 Pratyush Maini , Eric Wong , J. Zico Kolter

Robustness evaluation against adversarial examples has become increasingly important to unveil the trustworthiness of the prevailing deep models in natural language processing (NLP). However, in contrast to the computer vision domain where…

Computation and Language · Computer Science 2022-12-20 Bairu Hou , Jinghan Jia , Yihua Zhang , Guanhua Zhang , Yang Zhang , Sijia Liu , Shiyu Chang

Deep networks are well-known to be fragile to adversarial attacks. We conduct an empirical analysis of deep representations under the state-of-the-art attack method called PGD, and find that the attack causes the internal representation to…

Machine Learning · Computer Science 2019-10-29 Chengzhi Mao , Ziyuan Zhong , Junfeng Yang , Carl Vondrick , Baishakhi Ray

Designing powerful adversarial attacks is of paramount importance for the evaluation of $\ell_p$-bounded adversarial defenses. Projected Gradient Descent (PGD) is one of the most effective and conceptually simple algorithms to generate such…

Machine Learning · Computer Science 2022-12-16 Nikolaos Antoniou , Efthymios Georgiou , Alexandros Potamianos

In wireless network, the optimization problems generally have complex constraints, and are usually solved via utilizing the traditional optimization methods that have high computational complexity and need to be executed repeatedly with the…

Information Theory · Computer Science 2022-01-25 Shiwen He , Shaowen Xiong , Zhenyu An , Wei Zhang , Yongming Huang , Yaoxue Zhang

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

In this paper, we present a novel nonlinear programming-based approach to fine-tune pre-trained neural networks to improve robustness against adversarial attacks while maintaining high accuracy on clean data. Our method introduces…

Machine Learning · Computer Science 2024-10-28 Shudian Zhao , Jan Kronqvist

Recent advances show that deep neural networks are not robust to deliberately crafted adversarial examples which many are generated by adding human imperceptible perturbation to clear input. Consider $l_2$ norms attacks, Project Gradient…

Machine Learning · Computer Science 2019-06-11 Fanyou Wu , Rado Gazo , Eva Haviarova , Bedrich Benes

Deep neural networks are known to be vulnerable to adversarial perturbations, which are small and carefully crafted inputs that lead to incorrect predictions. In this paper, we propose DeepDefense, a novel defense framework that applies…

Machine Learning · Computer Science 2025-11-19 Ci Lin , Tet Yeap , Iluju Kiringa , Biwei Zhang

Evaluating the adversarial robustness of deep networks to gradient-based attacks is challenging. While most attacks consider $\ell_2$- and $\ell_\infty$-norm constraints to craft input perturbations, only a few investigate sparse $\ell_1$-…

Machine Learning · Computer Science 2025-03-07 Antonio Emanuele Cinà , Francesco Villani , Maura Pintor , Lea Schönherr , Battista Biggio , Marcello Pelillo

In many real-world applications of Machine Learning it is of paramount importance not only to provide accurate predictions, but also to ensure certain levels of robustness. Adversarial Training is a training procedure aiming at providing…

Machine Learning · Computer Science 2019-10-09 Matteo Terzi , Gian Antonio Susto , Pratik Chaudhari

In this paper we study the performance of the Projected Gradient Descent(PGD) algorithm for $\ell_{p}$-constrained least squares problems that arise in the framework of Compressed Sensing. Relying on the Restricted Isometry Property, we…

Numerical Analysis · Mathematics 2013-03-05 Sohail Bahmani , Bhiksha Raj

The Projected Gradient Descent (PGD) algorithm is a widely used and efficient first-order method for solving constrained optimization problems due to its simplicity and scalability in large design spaces. Building on recent advancements in…

Optimization and Control · Mathematics 2025-06-18 Lucka Barbeau , Marc-Étienne Lamarche-Gagnon , Florin Ilinca

This paper focuses on integrating the networks and adversarial training into constrained optimization problems to develop a framework algorithm for constrained optimization problems. For such problems, we first transform them into minimax…

Optimization and Control · Mathematics 2024-07-08 Gang Bao , Dong Wang , Boyi Zou

In recent years, stochastic gradient descent (SGD) methods and randomized linear algebra (RLA) algorithms have been applied to many large-scale problems in machine learning and data analysis. We aim to bridge the gap between these two…

Optimization and Control · Mathematics 2017-07-11 Jiyan Yang , Yin-Lam Chow , Christopher Ré , Michael W. Mahoney

Adversarial attacks on deep neural network models have seen rapid development and are extensively used to study the stability of these networks. Among various adversarial strategies, Projected Gradient Descent (PGD) is a widely adopted…

Machine Learning · Computer Science 2024-10-17 Dayana Savostianova , Emanuele Zangrando , Francesco Tudisco

Federated Learning (FL) enables multiple clients to collaboratively train models without sharing raw data, but it is highly vulnerable to Byzantine attacks. Existing robust approaches can neutralize these threats but incur substantial…

Machine Learning · Computer Science 2026-05-28 Shiyuan Zuo , Jiashuo Li , Rongfei Fan , Han Hu , Jie Xu

This paper solves a new class of optimization problems under uncertainty, called Probable Event Constrained Optimization (PECO), which optimizes an objective function of decision variables and subjects to a set of Probable Event Constraints…

Optimization and Control · Mathematics 2025-03-07 Qifeng Li

Adversarial attack has recently become a tremendous threat to deep learning models. To improve the robustness of machine learning models, adversarial training, formulated as a minimax optimization problem, has been recognized as one of the…

Machine Learning · Computer Science 2020-04-28 Yuanhao Xiong , Cho-Jui Hsieh
‹ Prev 1 2 3 10 Next ›