English
Related papers

Related papers: Eliminating Catastrophic Overfitting Via Abnormal …

200 papers

Catastrophic overfitting is a phenomenon observed during Adversarial Training (AT) with the Fast Gradient Sign Method (FGSM) where the test robustness steeply declines over just one epoch in the training stage. Prior work has attributed…

Machine Learning · Computer Science 2021-11-23 Varun Sivashankar , Nikil Selvam

In response to the threat of adversarial examples, adversarial training provides an attractive option for enhancing the model robustness by training models on online-augmented adversarial examples. However, most of the existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jia-Li Yin , Lehui Xie , Wanqing Zhu , Ximeng Liu , Bo-Hao Chen

With the wide application of deep neural network models in various computer vision tasks, there has been a proliferation of adversarial example generation strategies aimed at deeply exploring model security. However, existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wenxuan Wang , Chenglei Wang , Huihui Qi , Menghao Ye , Xuelin Qian , Peng Wang , Yanning Zhang

Use of an autoencoder (AE) as a normal model is a state-of-the-art technique for unsupervised-anomaly detection in sounds (ADS). The AE is trained to minimize the sample mean of the anomaly score of normal sounds in a mini-batch. One…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-22 Yuma Koizumi , Shoichiro Saito , Masataka Yamaguchi , Shin Murata , Noboru Harada

Adversarial training deep neural networks often experience serious overfitting problem. Recently, it is explained that the overfitting happens because the sample complexity of training data is insufficient to generalize robustness. In…

Machine Learning · Computer Science 2020-09-23 Joong-Won Hwang , Youngwan Lee , Sungchan Oh , Yuseok Bae

Despite their overwhelming success on a wide range of applications, convolutional neural networks (CNNs) are widely recognized to be vulnerable to adversarial examples. This intriguing phenomenon led to a competition between adversarial…

Machine Learning · Computer Science 2021-04-08 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

Deep Reinforcement Learning (DRL) policies are highly susceptible to adversarial noise in observations, which poses significant risks in safety-critical scenarios. The challenge inherent to adversarial perturbations is that by altering the…

Machine Learning · Computer Science 2025-04-25 Roman Belaire , Arunesh Sinha , Pradeep Varakantham

The progress in the last decade has enabled machine learning models to achieve impressive performance across a wide range of tasks in Computer Vision. However, a plethora of works have demonstrated the susceptibility of these models to…

Machine Learning · Computer Science 2020-02-06 B. S. Vivek , R. Venkatesh Babu

Deep neural networks (DNNs) have been shown to be vulnerable against adversarial examples (AEs), which are maliciously designed to cause dramatic model output errors. In this work, we reveal that normal examples (NEs) are insensitive to the…

Machine Learning · Computer Science 2021-03-09 Jinyu Tian , Jiantao Zhou , Yuanman Li , Jia Duan

In anomaly detection (AD), one seeks to identify whether a test sample is abnormal, given a data set of normal samples. A recent and promising approach to AD relies on deep generative models, such as variational autoencoders (VAEs), for…

Machine Learning · Computer Science 2021-11-05 Tal Daniel , Thanard Kurutach , Aviv Tamar

Adversarial machine learning is a well-studied field of research where an adversary causes predictable errors in a machine learning algorithm through precise manipulation of the input. Numerous techniques have been proposed to harden…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Pratik Vaishnavi , Kevin Eykholt , Atul Prakash , Amir Rahmati

Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets,…

Machine Learning · Computer Science 2021-07-30 Wentao Wang , Han Xu , Xiaorui Liu , Yaxin Li , Bhavani Thuraisingham , Jiliang Tang

Due to the surprisingly good representation power of complex distributions, neural network (NN) classifiers are widely used in many tasks which include natural language processing, computer vision and cyber security. In recent works, people…

Machine Learning · Computer Science 2019-06-28 Guanxiong Liu , Issa Khalil , Abdallah Khreishah

Deep latent variable models, trained using variational autoencoders or generative adversarial networks, are now a key technique for representation learning of continuous structures. However, applying similar methods to discrete structures,…

Machine Learning · Computer Science 2018-07-02 Jake Zhao , Yoon Kim , Kelly Zhang , Alexander M. Rush , Yann LeCun

This paper proposes Evolutionary Multi-objective Optimization (EMO)-based Adversarial Example (AE) design method that performs under black-box setting. Previous gradient-based methods produce AEs by changing all pixels of a target image,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Takahiro Suzuki , Shingo Takeshita , Satoshi Ono

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense…

Machine Learning · Computer Science 2022-08-02 Jay Nandy , Sudipan Saha , Wynne Hsu , Mong Li Lee , Xiao Xiang Zhu

Detecting anomalies in images and video is an essential task for multiple real-world problems, including industrial inspection, computer-assisted diagnosis, and environmental monitoring. Anomaly detection is typically formulated as a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Declan McIntosh , Alexandra Branzan Albu

Deep neural network-based Synthetic Aperture Radar (SAR) target recognition models are susceptible to adversarial examples. Current adversarial example generation methods for SAR imagery primarily operate in the 2D digital domain, known as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jiahao Cui , Jiale Duan , Binyan Luo , Hang Cao , Wang Guo , Haifeng Li

Object detectors encounter challenges in handling domain shifts. Cutting-edge domain adaptive object detection methods use the teacher-student framework and domain adversarial learning to generate domain-invariant pseudo-labels for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Kaiwen Wang , Yinzhe Shen , Martin Lauer

Deep neural networks (DNNs) have shown huge superiority over humans in image recognition, speech processing, autonomous vehicles and medical diagnosis. However, recent studies indicate that DNNs are vulnerable to adversarial examples (AEs),…

Machine Learning · Computer Science 2019-09-24 Jiliang Zhang , Chen Li