English
Related papers

Related papers: Testing Robustness Against Unforeseen Adversaries

200 papers

Adversarial robustness has been studied extensively in image classification, especially for the $\ell_\infty$-threat model, but significantly less so for related tasks such as object detection and semantic segmentation, where attacks turn…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Francesco Croce , Naman D Singh , Matthias Hein

Recently, the problem of robustness of pre-trained language models (PrLMs) has received increasing research interest. Latest studies on adversarial attacks achieve high attack success rates against PrLMs, claiming that PrLMs are not robust.…

Machine Learning · Computer Science 2022-03-23 Jiayi Wang , Rongzhou Bao , Zhuosheng Zhang , Hai Zhao

Despite providing high-performance solutions for computer vision tasks, the deep neural network (DNN) model has been proved to be extremely vulnerable to adversarial attacks. Current defense mainly focuses on the known attacks, but the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Lei Zhang , Yuhang Zhou , Yi Yang , Xinbo Gao

Adversarial attacks pose a critical security threat to real-world AI systems by injecting human-imperceptible perturbations into benign samples to induce misclassification in deep learning models. While existing detection methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yinghe Zhang , Chi Liu , Shuai Zhou , Sheng Shen , Peng Gui

Convolutional neural networks have been used to achieve a string of successes during recent years, but their lack of interpretability remains a serious issue. Adversarial examples are designed to deliberately fool neural networks into…

Machine Learning · Computer Science 2020-04-28 Jan Philip Göpfert , André Artelt , Heiko Wersing , Barbara Hammer

Adversarial training yields robust models against a specific threat model, e.g., $L_\infty$ adversarial examples. Typically robustness does not generalize to previously unseen threat models, e.g., other $L_p$ norms, or larger perturbations.…

Machine Learning · Computer Science 2020-07-01 David Stutz , Matthias Hein , Bernt Schiele

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Current research on defending against adversarial examples focuses primarily on achieving robustness against a single attack type such as $\ell_2$ or $\ell_{\infty}$-bounded attacks. However, the space of possible perturbations is much…

Machine Learning · Computer Science 2024-10-10 Sihui Dai , Chong Xiang , Tong Wu , Prateek Mittal

While state-of-the-art Deep Neural Network (DNN) models are considered to be robust to random perturbations, it was shown that these architectures are highly vulnerable to deliberately crafted perturbations, albeit being…

Machine Learning · Computer Science 2021-06-03 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil

Adversarial phenomenon has been widely observed in machine learning (ML) systems, especially in those using deep neural networks, describing that ML systems may produce inconsistent and incomprehensible predictions with humans at some…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Baoyuan Wu , Shaokui Wei , Mingli Zhu , Meixi Zheng , Zihao Zhu , Mingda Zhang , Hongrui Chen , Danni Yuan , Li Liu , Qingshan Liu

There has been considerable and growing interest in applying machine learning for cyber defenses. One promising approach has been to apply natural language processing techniques to analyze logs data for suspicious behavior. A natural…

Machine Learning · Computer Science 2020-07-30 Kai Steverson , Jonathan Mullin , Metin Ahiskali

In this work we develop a novel Bayesian neural network methodology to achieve strong adversarial robustness without the need for online adversarial training. Unlike previous efforts in this direction, we do not rely solely on the…

Machine Learning · Computer Science 2020-03-25 Christopher M. Bender , Yang Li , Yifeng Shi , Michael K. Reiter , Junier B. Oliva

Adversarial learning and the robustness of Graph Neural Networks (GNNs) are topics of widespread interest in the machine learning community, as documented by the number of adversarial attacks and defenses designed for these purposes. While…

Machine Learning · Computer Science 2026-05-08 Tran Gia Bao Ngo , Zulfikar Alom , Federico Errica , Murat Kantarcioglu , Cuneyt Gurcan Akcora

Correctly evaluating defenses against adversarial examples has proven to be extremely difficult. Despite the significant amount of recent work attempting to design defenses that withstand adaptive attacks, few have succeeded; most papers…

The escalating threat of adversarial attacks on deep learning models, particularly in security-critical fields, has underscored the need for robust deep learning systems. Conventional robustness evaluations have relied on adversarial…

Cryptography and Security · Computer Science 2024-11-19 Ping Guo , Cheng Gong , Xi Lin , Zhiyuan Yang , Qingfu Zhang

In the past decades, the rise of artificial intelligence has given us the capabilities to solve the most challenging problems in our day-to-day lives, such as cancer prediction and autonomous navigation. However, these applications might…

Cryptography and Security · Computer Science 2022-09-13 Ehsan Nowroozi , Mohammadreza Mohammadi , Pargol Golmohammadi , Yassine Mekdad , Mauro Conti , Selcuk Uluagac

Machine-learning models demand periodic updates to improve their average accuracy, exploiting novel architectures and additional data. However, a newly updated model may commit mistakes the previous model did not make. Such…

Machine Learning · Computer Science 2025-05-30 Daniele Angioni , Luca Demetrio , Maura Pintor , Luca Oneto , Davide Anguita , Battista Biggio , Fabio Roli

Progress in making neural networks more robust against adversarial attacks is mostly marginal, despite the great efforts of the research community. Moreover, the robustness evaluation is often imprecise, making it difficult to identify…

Machine Learning · Computer Science 2021-05-26 Leo Schwinn , René Raab , An Nguyen , Dario Zanca , Bjoern Eskofier

Deep learning (DL)-based automated cybersickness detection methods, along with adaptive mitigation techniques, can enhance user comfort and interaction. However, recent studies show that these DL-based systems are susceptible to adversarial…

Cryptography and Security · Computer Science 2025-12-22 Istiak Ahmed , Ripan Kumar Kundu , Khaza Anuarul Hoque

We present a new algorithm to train a robust malware detector. Modern malware detectors rely on machine learning algorithms. Now, the adversarial objective is to devise alterations to the malware code to decrease the chance of being…