English
Related papers

Related papers: Practical Evaluation of Adversarial Robustness via…

200 papers

While great progress has been made at making neural networks effective across a wide range of visual tasks, most models are surprisingly vulnerable. This frailness takes the form of small, carefully chosen perturbations of their input,…

Machine Learning · Computer Science 2019-06-11 Cecilia Summers , Michael J. Dinneen

Nowadays, pretrained models are increasingly used as general-purpose backbones and adapted at test-time to downstream environments where target data are scarce and unlabeled. While this paradigm has proven effective for improving clean…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Stefano Bianchettin , Giulio Rossolini , Giorgio Buttazzo

Due to the vulnerability of deep neural networks (DNNs) to adversarial examples, a large number of defense techniques have been proposed to alleviate this problem in recent years. However, the progress of building more robust models is…

Deep neural networks are vulnerable to adversarial examples. Adversarial training (AT) is an effective defense against adversarial examples. However, AT is prone to overfitting which degrades robustness substantially. Recently, data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Lin Li , Jianing Qiu , Michael Spratling

Adversarial training, the process of training a deep learning model with adversarial data, is one of the most successful adversarial defense methods for deep learning models. We have found that the robustness to white-box attack of an…

Machine Learning · Computer Science 2021-12-24 Zhiwen Yan , Teck Khim Ng

Adversarial training has become the primary method to defend against adversarial samples. However, it is hard to practically apply due to many shortcomings. One of the shortcomings of adversarial training is that it will reduce the…

Machine Learning · Computer Science 2021-08-31 Zhishen Nie , Ying Lin , Sp Ren , Lan Zhang

This paper investigates recently proposed approaches for defending against adversarial examples and evaluating adversarial robustness. We motivate 'adversarial risk' as an objective for achieving models robust to worst-case inputs. We then…

Machine Learning · Computer Science 2018-06-13 Jonathan Uesato , Brendan O'Donoghue , Aaron van den Oord , Pushmeet Kohli

Despite significant advancements in deep reinforcement learning (DRL)-based autonomous driving policies, these policies still exhibit vulnerability to adversarial attacks. This vulnerability poses a formidable challenge to the practical…

Machine Learning · Computer Science 2024-12-05 Junchao Fan , Xuyang Lei , Xiaolin Chang , Jelena Mišić , Vojislav B. Mišić

Adversarial training aims to defend against adversaries: malicious opponents whose sole aim is to harm predictive performance in any way possible. This presents a rather harsh perspective, which we assert results in unnecessarily…

Machine Learning · Computer Science 2025-06-10 Maayan Ehrenberg , Roy Ganz , Nir Rosenfeld

Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the…

Machine Learning · Computer Science 2022-03-04 Mo Zhou , Vishal M. Patel

Adversarial training is so far the most effective strategy in defending against adversarial examples. However, it suffers from high computational costs due to the iterative adversarial attacks in each training step. Recent studies show that…

Machine Learning · Computer Science 2022-01-03 Jinghui Chen , Yu Cheng , Zhe Gan , Quanquan Gu , Jingjing Liu

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense…

Machine Learning · Computer Science 2022-08-02 Jay Nandy , Sudipan Saha , Wynne Hsu , Mong Li Lee , Xiao Xiang Zhu

This paper documents early research conducted in 2022 on defending against prompt injection attacks in large language models, providing historical context for the evolution of this critical security domain. This research focuses on two…

Cryptography and Security · Computer Science 2025-09-19 Gustavo Sandoval , Denys Fenchenko , Junyao Chen

Like many other tasks involving neural networks, Speech Recognition models are vulnerable to adversarial attacks. However recent research has pointed out differences between attacks and defenses on ASR models compared to image models.…

Cryptography and Security · Computer Science 2022-04-06 Raphael Olivier , Bhiksha Raj

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Adversarial training (AT) is widely considered the state-of-the-art technique for improving the robustness of deep neural networks (DNNs) against adversarial examples (AE). Nevertheless, recent studies have revealed that adversarially…

Machine Learning · Computer Science 2023-08-04 Chenhao Lin , Xiang Ji , Yulong Yang , Qian Li , Chao Shen , Run Wang , Liming Fang

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Evaluating the robustness of automated driving planners is a critical and challenging task. Although methodologies to evaluate vehicles are well established, they do not yet account for a reality in which vehicles with autonomous components…

Cryptography and Security · Computer Science 2022-05-31 Andres Molina-Markham , Silvia G. Ionescu , Erin Lanus , Derek Ng , Sam Sommerer , Joseph J. Rushanan

Recent breakthroughs in the field of deep learning have led to advancements in a broad spectrum of tasks in computer vision, audio processing, natural language processing and other areas. In most instances where these tasks are deployed in…

Machine Learning · Computer Science 2019-05-28 Daanish Ali Khan , Linhong Li , Ninghao Sha , Zhuoran Liu , Abelino Jimenez , Bhiksha Raj , Rita Singh