English
Related papers

Related papers: Adversarial Robustness via Fisher-Rao Regularizati…

200 papers

The growing use of large pre-trained models in edge computing has made model inference on mobile clients both feasible and popular. Yet these devices remain vulnerable to adversarial attacks, threatening model robustness and security.…

Cryptography and Security · Computer Science 2026-02-17 Tianyu Qi , Lei Xue , Yufeng Zhan , Xiaobo Ma

In this paper we propose a new family of algorithms, ATENT, for training adversarially robust deep neural networks. We formulate a new loss function that is equipped with an additional entropic regularization. Our loss function considers…

Machine Learning · Computer Science 2021-02-22 Gauri Jagatap , Ameya Joshi , Animesh Basak Chowdhury , Siddharth Garg , Chinmay Hegde

In the present day we use machine learning for sensitive tasks that require models to be both understandable and robust. Although traditional models such as decision trees are understandable, they suffer from adversarial attacks. When a…

Machine Learning · Computer Science 2020-12-21 Daniël Vos , Sicco Verwer

Robustness to adversarial attacks is an important concern due to the fragility of deep neural networks to small perturbations and has received an abundance of attention in recent years. Distributionally Robust Optimization (DRO), a…

Machine Learning · Statistics 2020-06-09 Hisham Husain

In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other…

Machine Learning · Computer Science 2021-06-01 Jingfeng Zhang , Jianing Zhu , Gang Niu , Bo Han , Masashi Sugiyama , Mohan Kankanhalli

Deep learning models continue to advance in accuracy, yet they remain vulnerable to adversarial attacks, which often lead to the misclassification of adversarial examples. Adversarial training is used to mitigate this problem by increasing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Leo Hyun Park , Jaeuk Kim , Myung Gyo Oh , Jaewoo Park , Taekyoung Kwon

It is broadly known that deep neural networks are susceptible to being fooled by adversarial examples with perturbations imperceptible by humans. Various defenses have been proposed to improve adversarial robustness, among which adversarial…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Ying Wu

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

Machine Learning · Computer Science 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao

Neural ranking models (NRMs) have shown great success in information retrieval (IR). But their predictions can easily be manipulated using adversarial examples, which are crafted by adding imperceptible perturbations to legitimate…

Information Retrieval · Computer Science 2023-12-19 Yu-An Liu , Ruqing Zhang , Mingkun Zhang , Wei Chen , Maarten de Rijke , Jiafeng Guo , Xueqi Cheng

In recent years, there has been an explosion of research into developing more robust deep neural networks against adversarial examples. Adversarial training appears as one of the most successful methods. To deal with both the robustness…

Machine Learning · Computer Science 2023-03-21 Gaojie Jin , Xinping Yi , Dengyu Wu , Ronghui Mu , Xiaowei Huang

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a…

Machine Learning · Computer Science 2022-07-04 Idan Attias , Aryeh Kontorovich , Yishay Mansour

While existing work in robust deep learning has focused on small pixel-level norm-based perturbations, this may not account for perturbations encountered in several real-world settings. In many such cases although test data might not be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Tejas Gokhale , Rushil Anirudh , Bhavya Kailkhura , Jayaraman J. Thiagarajan , Chitta Baral , Yezhou Yang

Regularization, whether explicit in terms of a penalty in the loss or implicit in the choice of algorithm, is a cornerstone of modern machine learning. Indeed, controlling the complexity of the model class is particularly important when…

Machine Learning · Statistics 2024-10-22 Matteo Vilucchio , Nikolaos Tsilivis , Bruno Loureiro , Julia Kempe

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

Adversarial training (AT) methods are effective against adversarial attacks, yet they introduce severe disparity of accuracy and robustness between different classes, known as the robust fairness problem. Previously proposed Fair Robust…

Machine Learning · Computer Science 2022-09-19 Chunyu Sun , Chenye Xu , Chengyuan Yao , Siyuan Liang , Yichao Wu , Ding Liang , XiangLong Liu , Aishan Liu

Machine learning models are often trained on data from one distribution and deployed on others. So it becomes important to design models that are robust to distribution shifts. Most of the existing work focuses on optimizing for either…

Machine Learning · Computer Science 2021-03-31 Harvineet Singh , Shalmali Joshi , Finale Doshi-Velez , Himabindu Lakkaraju

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

One popular hypothesis of neural network generalization is that the flat local minima of loss surface in parameter space leads to good generalization. However, we demonstrate that loss surface in parameter space has no obvious relationship…

Machine Learning · Computer Science 2018-10-16 Fuxun Yu , Chenchen Liu , Yanzhi Wang , Liang Zhao , Xiang Chen

Adversarial training has been shown as an effective approach to improve the robustness of image classifiers against white-box attacks. However, its effectiveness against black-box attacks is more nuanced. In this work, we demonstrate that…

Machine Learning · Computer Science 2021-07-27 Ali Rahmati , Seyed-Mohsen Moosavi-Dezfooli , Huaiyu Dai

Adversarial robustness has become an important research topic given empirical demonstrations on the lack of robustness of deep neural networks. Unfortunately, recent theoretical results suggest that adversarial training induces a strict…

Machine Learning · Computer Science 2020-03-25 Matt Olfat , Anil Aswani