English
Related papers

Related papers: Boosting Adversarial Robustness From The Perspecti…

200 papers

Although the recent progress is substantial, deep learning methods can be vulnerable to the maliciously generated adversarial examples. In this paper, we present a novel training procedure and a thresholding test strategy, towards robust…

Machine Learning · Computer Science 2018-11-08 Tianyu Pang , Chao Du , Yinpeng Dong , Jun Zhu

Vulnerability to adversarial attacks is a well-known weakness of Deep Neural networks. While most of the studies focus on single-task neural networks with computer vision datasets, very little research has considered complex multi-task…

Machine Learning · Computer Science 2021-10-29 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

Machine Learning · Computer Science 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia

Adversarial training is one of the best-performing methods in improving the robustness of deep language models. However, robust models come at the cost of high time consumption, as they require multi-step gradient ascents or word…

Computation and Language · Computer Science 2023-06-28 Songyang Gao , Shihan Dou , Yan Liu , Xiao Wang , Qi Zhang , Zhongyu Wei , Jin Ma , Ying Shan

Deep learning models have shown considerable vulnerability to adversarial attacks, particularly as attacker strategies become more sophisticated. While traditional adversarial training (AT) techniques offer some resilience, they often focus…

Machine Learning · Computer Science 2024-07-15 Ren Wang , Yuxuan Li , Alfred Hero

In recent years, it has been found that neural networks can be easily fooled by adversarial examples, which is a potential safety hazard in some safety-critical applications. Many researchers have proposed various method to make neural…

Machine Learning · Computer Science 2018-04-24 Shuangtao Li , Yuanke Chen , Yanlin Peng , Lin Bai

Deep neural networks (DNNs) are vulnerable to subtle adversarial perturbations applied to the input. These adversarial perturbations, though imperceptible, can easily mislead the DNN. In this work, we take a control theoretic approach to…

Machine Learning · Computer Science 2019-11-13 Arash Rahnama , Andre T. Nguyen , Edward Raff

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Supervised training of deep neural nets typically relies on minimizing cross-entropy. However, in many domains, we are interested in performing well on metrics specific to the application. In this paper we propose a direct loss minimization…

Machine Learning · Computer Science 2016-06-03 Yang Song , Alexander G. Schwing , Richard S. Zemel , Raquel Urtasun

In this paper, the robustness and accuracy of the deep neural network (DNN) was enhanced by introducing the $L_{2,\infty}$ normalization of the weight matrices of the DNN with Relu as the activation function. It is proved that the…

Machine Learning · Statistics 2020-10-13 Lijia Yu , Xiao-Shan Gao

Deep Neural Networks (DNNs) are everywhere, frequently performing a fairly complex task that used to be unimaginable for machines to carry out. In doing so, they do a lot of decision making which, depending on the application, may be…

Machine Learning · Computer Science 2022-11-17 Avriti Chauhan , Mohammad Afzal , Hrishikesh Karmarkar , Yizhak Elboher , Kumar Madhukar , Guy Katz

With a growing need to enable intelligence in embedded devices in the Internet of Things (IoT) era, secure hardware implementation of Deep Neural Networks (DNNs) has become imperative. We will focus on how to address adversarial robustness…

Machine Learning · Computer Science 2021-09-08 Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

Adversarial Training (AT) has been demonstrated to improve the robustness of deep neural networks (DNNs) against adversarial attacks. AT is a min-max optimization procedure where in adversarial examples are generated to train a more robust…

Machine Learning · Computer Science 2024-12-31 Olukorede Fakorede , Modeste Atsague , Jin Tian

Ensuring robustness of Deep Neural Networks (DNNs) is crucial to their adoption in safety-critical applications such as self-driving cars, drones, and healthcare. Notably, DNNs are vulnerable to adversarial attacks in which small input…

Machine Learning · Computer Science 2020-04-22 Sanchari Sen , Balaraman Ravindran , Anand Raghunathan

As deep neural networks (DNNs) are increasingly deployed in sensitive applications, ensuring their security and robustness has become critical. A major threat to DNNs arises from adversarial attacks, where small input perturbations can lead…

Machine Learning · Computer Science 2025-11-27 Erh-Chung Chen , Pin-Yu Chen , I-Hsin Chung , Che-Rung Lee

As deep learning (DL) models are increasingly being integrated into our everyday lives, ensuring their safety by making them robust against adversarial attacks has become increasingly critical. DL models have been found to be susceptible to…

Machine Learning · Computer Science 2026-05-29 Hallgrimur Thorsteinsson , Valdemar J Henriksen , Daniel I R Cruz , Raghavendra Selvan , Tong Chen

Training Deep Neural Networks (DNNs) with adversarial examples often results in poor generalization to test-time adversarial data. This paper investigates this issue, known as adversarially robust generalization, through the lens of…

Machine Learning · Statistics 2024-06-11 Jiancong Xiao , Ruoyu Sun , Qi Long , Weijie J. Su

Non-adversarial robustness, also known as natural robustness, is a property of deep learning models that enables them to maintain performance even when faced with distribution shifts caused by natural variations in data. However, achieving…

Machine Learning · Computer Science 2023-05-25 Gorana Gojić , Vladimir Vincan , Ognjen Kundačina , Dragiša Mišković , Dinu Dragan

Deep neural networks are vulnerable to adversarial attacks. Recent studies about adversarial robustness focus on the loss landscape in the parameter space since it is related to optimization and generalization performance. These studies…

Machine Learning · Computer Science 2023-03-07 Sekitoshi Kanai , Masanori Yamada , Hiroshi Takahashi , Yuki Yamanaka , Yasutoshi Ida

Lifted neural networks (i.e. neural architectures explicitly optimizing over respective network potentials to determine the neural activities) can be combined with a type of adversarial training to gain robustness for internal as well as…

Machine Learning · Computer Science 2025-03-12 Christopher Zach