English
Related papers

Related papers: WITCHcraft: Efficient PGD attacks with random step…

200 papers

Advances in the development of adversarial attacks have been fundamental to the progress of adversarial defense research. Efficient and effective attacks are crucial for reliable evaluation of defenses, and also for developing robust…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Gaurang Sriramanan , Sravanti Addepalli , Arya Baburaj , R. Venkatesh Babu

It is well known that, for most datasets, the use of large-size minibatches for Stochastic Gradient Descent (SGD) typically leads to slow convergence and poor generalization. On the other hand, large minibatches are of great practical…

Machine Learning · Computer Science 2018-06-20 Matteo Fischetti , Iacopo Mandatelli , Domenico Salvagnin

Applying Differentially Private Stochastic Gradient Descent (DPSGD) to training modern, large-scale neural networks such as transformer-based models is a challenging task, as the magnitude of noise added to the gradients at each iteration…

Machine Learning · Computer Science 2022-07-07 Ryuichi Ito , Seng Pei Liew , Tsubasa Takahashi , Yuya Sasaki , Makoto Onizuka

While deep neural networks have proven to be a powerful tool for many recognition and classification tasks, their stability properties are still not well understood. In the past, image classifiers have been shown to be vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Rima Alaifari , Giovanni S. Alberti , Tandri Gauksson

Dynamic neural networks can greatly reduce computation redundancy without compromising accuracy by adapting their structures based on the input. In this paper, we explore the robustness of dynamic neural networks against energy-oriented…

Cryptography and Security · Computer Science 2023-04-17 Jianhong Pan , Lin Geng Foo , Qichen Zheng , Zhipeng Fan , Hossein Rahmani , Qiuhong Ke , Jun Liu

In manufacturing, unexpected failures are considered a primary operational risk, as they can hinder productivity and can incur huge losses. State-of-the-art Prognostics and Health Management (PHM) systems incorporate Deep Learning (DL)…

Machine Learning · Computer Science 2020-09-29 Gautam Raj Mode , Khaza Anuarul Hoque

As deep neural networks (DNNs) are increasingly deployed in sensitive applications, ensuring their security and robustness has become critical. A major threat to DNNs arises from adversarial attacks, where small input perturbations can lead…

Machine Learning · Computer Science 2025-11-27 Erh-Chung Chen , Pin-Yu Chen , I-Hsin Chung , Che-Rung Lee

In this paper, we propose a new Deep Neural Network (DNN) testing algorithm called the Constrained Gradient Descent (CGD) method, and an implementation we call CGDTest aimed at exposing security and robustness issues such as adversarial…

Machine Learning · Computer Science 2023-04-05 Vineel Nagisetty , Laura Graves , Guanting Pan , Piyush Jha , Vijay Ganesh

Ptychography is an emerging imaging technique that is able to provide wavelength-limited spatial resolution from specimen with extended lateral dimensions. As a scanning microscopy method, a typical two-dimensional image requires a number…

Adversarial examples contain small perturbations that can remain imperceptible to human observers but alter the behavior of even the best performing deep learning models and yield incorrect outputs. Since their discovery, adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Andras Rozsa , Terrance E. Boult

Robustness evaluation against adversarial examples has become increasingly important to unveil the trustworthiness of the prevailing deep models in natural language processing (NLP). However, in contrast to the computer vision domain where…

Computation and Language · Computer Science 2022-12-20 Bairu Hou , Jinghan Jia , Yihua Zhang , Guanhua Zhang , Yang Zhang , Sijia Liu , Shiyu Chang

Deep learning models are vulnerable to adversarial examples, posing critical security challenges in real-world applications. While Adversarial Training (AT ) is a widely adopted defense mechanism to enhance robustness, it often incurs a…

Machine Learning · Computer Science 2025-09-16 Jing Zou , Shungeng Zhang , Meikang Qiu , Chong Li

Data-driven iterative learning control can achieve high performance for systems performing repeating tasks without the need for modeling. The aim of this paper is to develop a fast data-driven method for iterative learning control that is…

Systems and Control · Electrical Eng. & Systems 2021-11-17 Leontine Aarnoudse , Tom Oomen

Federated Graph Learning (FedGL) is vulnerable to malicious attacks, yet developing a truly effective and stealthy attack method remains a significant challenge. Existing attack methods suffer from low attack success rates, high…

Machine Learning · Computer Science 2026-03-10 Jinshan Liu , Ken Li , Jiazhe Wei , Bin Shi , Bo Dong

Recently, deep neural networks have significant progress and successful application in various fields, but they are found vulnerable to attack instances, e.g., adversarial examples. State-of-art attack methods can generate attack images by…

Machine Learning · Computer Science 2019-03-19 Ping Yu , Kaitao Song , Jianfeng Lu

Modern neural networks are highly non-robust against adversarial manipulation. A significant amount of work has been invested in techniques to compute lower bounds on robustness through formal guarantees and to build provably robust models.…

Machine Learning · Computer Science 2019-09-26 Francesco Croce , Jonas Rauber , Matthias Hein

In the setting of nonparametric regression, we propose and study a combination of stochastic gradient methods with Nystr\"om subsampling, allowing multiple passes over the data and mini-batches. Generalization error bounds for the studied…

Machine Learning · Statistics 2017-10-24 Junhong Lin , Lorenzo Rosasco

In this paper, we study fast training of adversarially robust models. From the analyses of the state-of-the-art defense method, i.e., the multi-step adversarial training, we hypothesize that the gradient magnitude links to the model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jianyu Wang , Haichao Zhang

In this paper, we introduce proximal gradient temporal difference learning, which provides a principled way of designing and analyzing true stochastic gradient temporal difference learning algorithms. We show how gradient TD (GTD)…

Machine Learning · Computer Science 2020-06-09 Bo Liu , Ian Gemp , Mohammad Ghavamzadeh , Ji Liu , Sridhar Mahadevan , Marek Petrik

Deep learning models are known to be vulnerable to adversarial examples crafted by adding human-imperceptible perturbations on benign images. Many existing adversarial attack methods have achieved great white-box attack performance, but…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Xiaosen Wang , Jiadong Lin , Han Hu , Jingdong Wang , Kun He