English
Related papers

Related papers: On Evaluating the Adversarial Robustness of Semant…

200 papers

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Research on adversarial robustness in language models is currently fragmented across applications and attacks, obscuring shared vulnerabilities. In this work, we propose unifying the study of adversarial robustness in text scoring models…

Computation and Language · Computer Science 2026-02-03 Manveer Singh Tamber , Hosna Oyarhoseini , Jimmy Lin

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

Machine Learning · Computer Science 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Deep learning models achieve remarkable accuracy in computer vision tasks, yet remain vulnerable to adversarial examples--carefully crafted perturbations to input images that can deceive these models into making confident but incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Khoi Nguyen Tiet Nguyen , Wenyu Zhang , Kangkang Lu , Yuhuan Wu , Xingjian Zheng , Hui Li Tan , Liangli Zhen

Owing to the susceptibility of deep learning systems to adversarial attacks, there has been a great deal of work in developing (both empirically and certifiably) robust classifiers. While most work has defended against a single type of…

Machine Learning · Computer Science 2020-07-30 Pratyush Maini , Eric Wong , J. Zico Kolter

Adversarial examples, generated by applying small perturbations to input features, are widely used to fool classifiers and measure their robustness to noisy inputs. However, little work has been done to evaluate the robustness of ranking…

Information Retrieval · Computer Science 2020-08-06 Nisarg Raval , Manisha Verma

Despite the recent advances in a wide spectrum of applications, machine learning models, especially deep neural networks, have been shown to be vulnerable to adversarial attacks. Attackers add carefully-crafted perturbations to input, where…

Machine Learning · Computer Science 2020-10-08 Ninghao Liu , Mengnan Du , Ruocheng Guo , Huan Liu , Xia Hu

An adversarial attack paradigm explores various scenarios for the vulnerability of deep learning models: minor changes of the input can force a model failure. Most of the state of the art frameworks focus on adversarial attacks for images…

Machine Learning · Computer Science 2020-06-22 I. Fursov , A. Zaytsev , N. Kluchnikov , A. Kravchenko , E. Burnaev

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

Machine Learning · Computer Science 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

It is well known that deep neural networks (DNNs) are vulnerable to adversarial attacks, which are implemented by adding crafted perturbations onto benign examples. Min-max robust optimization based adversarial training can provide a notion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Shaokai Ye , Kaidi Xu , Sijia Liu , Jan-Henrik Lambrechts , Huan Zhang , Aojun Zhou , Kaisheng Ma , Yanzhi Wang , Xue Lin

Image attribution -- matching an image back to a trusted source -- is an emerging tool in the fight against online misinformation. Deep visual fingerprinting models have recently been explored for this purpose. However, they are not robust…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Maksym Andriushchenko , Xiaoyang Rebecca Li , Geoffrey Oxholm , Thomas Gittings , Tu Bui , Nicolas Flammarion , John Collomosse

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

Adversarial training is one of the most effective approaches to improve model robustness against adversarial examples. However, previous works mainly focus on the overall robustness of the model, and the in-depth analysis on the role of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Qi Tian , Kun Kuang , Kelu Jiang , Fei Wu , Yisen Wang

Deep neural networks for computer vision are deployed in increasingly safety-critical and socially-impactful applications, motivating the need to close the gap in model performance under varied, naturally occurring imaging conditions.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Nathan Drenkow , Numair Sani , Ilya Shpitser , Mathias Unberath

In recent years, it has been found that neural networks can be easily fooled by adversarial examples, which is a potential safety hazard in some safety-critical applications. Many researchers have proposed various method to make neural…

Machine Learning · Computer Science 2018-04-24 Shuangtao Li , Yuanke Chen , Yanlin Peng , Lin Bai

Volumetric medical segmentation models have achieved significant success on organ and tumor-based segmentation tasks in recent years. However, their vulnerability to adversarial attacks remains largely unexplored, raising serious concerns…

Image and Video Processing · Electrical Eng. & Systems 2024-09-04 Hashmat Shadab Malik , Numan Saeed , Asif Hanif , Muzammal Naseer , Mohammad Yaqub , Salman Khan , Fahad Shahbaz Khan

In this paper, for the first time, we propose an evaluation method for deep learning models that assesses the performance of a model not only in an unseen test scenario, but also in extreme cases of noise, outliers and ambiguous input data.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Magdalini Paschali , Sailesh Conjeti , Fernando Navarro , Nassir Navab