English
Related papers

Related papers: Eliminating Catastrophic Overfitting Via Abnormal …

200 papers

As a powerful approach for exploratory data analysis, unsupervised clustering is a fundamental task in computer vision and pattern recognition. Many clustering algorithms have been developed, but most of them perform unsatisfactorily on the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Pengfei Ge , Chuan-Xian Ren , Jiashi Feng , Shuicheng Yan

A recent line of work focused on making adversarial training computationally efficient for deep learning models. In particular, Wong et al. (2020) showed that $\ell_\infty$-adversarial training with fast gradient sign method (FGSM) can fail…

Machine Learning · Computer Science 2020-10-27 Maksym Andriushchenko , Nicolas Flammarion

Adversarial Training (AT) has been demonstrated to improve the robustness of deep neural networks (DNNs) against adversarial attacks. AT is a min-max optimization procedure where in adversarial examples are generated to train a more robust…

Machine Learning · Computer Science 2024-12-31 Olukorede Fakorede , Modeste Atsague , Jin Tian

Adversarial training is extensively utilized to improve the adversarial robustness of deep neural networks. Yet, mitigating the degradation of standard generalization performance in adversarial-trained models remains an open problem. This…

Machine Learning · Computer Science 2024-03-27 Xiangyu Yin , Wenjie Ruan

Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks. However, the phenomenon of robust overfitting, i.e., the robustness starts to decrease significantly…

Machine Learning · Computer Science 2021-12-23 Jihoon Tack , Sihyun Yu , Jongheon Jeong , Minseon Kim , Sung Ju Hwang , Jinwoo Shin

Adversarial examples (AEs) are crafted by adding human-imperceptible perturbations to inputs such that a machine-learning based classifier incorrectly labels them. They have become a severe threat to the trustworthiness of machine learning.…

Sound · Computer Science 2019-12-05 Qiang Zeng , Jianhai Su , Chenglong Fu , Golam Kayas , Lannan Luo

This paper studies fast adversarial training against sparse adversarial perturbations bounded by $l_0$ norm. We demonstrate the challenges of employing $1$-step attacks on $l_0$ bounded perturbations for fast adversarial training, including…

Machine Learning · Computer Science 2025-11-03 Xuyang Zhong , Yixiao Huang , Chen Liu

Due to the rare occurrence of anomalous events, a typical approach to anomaly detection is to train an autoencoder (AE) with normal data only so that it learns the patterns or representations of the normal training data. At test time, the…

Machine Learning · Computer Science 2024-05-20 Marcella Astrid , Muhammad Zaigham Zaheer , Djamila Aouada , Seung-Ik Lee

Adversarial training is wildly considered as one of the most effective way to defend against adversarial examples. However, existing adversarial training methods consume unbearable time, due to the fact that they need to generate…

Machine Learning · Computer Science 2021-03-10 Yaguan Qian , Qiqi Shao , Tengteng Yao , Bin Wang , Shouling Ji , Shaoning Zeng , Zhaoquan Gu , Wassim Swaileh

Remarkable successes were made in Medical Image Classification (MIC) recently, mainly due to wide applications of convolutional neural networks (CNNs). However, adversarial examples (AEs) exhibited imperceptible similarity with raw data,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Shuai Li , Xiaoguang Ma , Shancheng Jiang , Lu Meng

Anomaly detection is the task of recognising novel samples which deviate significantly from pre-establishednormality. Abnormal classes are not present during training meaning that models must learn effective rep-resentations solely across…

Machine Learning · Computer Science 2023-03-08 Jack W Barker , Neelanjan Bhowmik , Yona Falinie A Gaus , Toby P Breckon

Adversarial examples (AEs) are images that can mislead deep neural network (DNN) classifiers via introducing slight perturbations into original images. This security vulnerability has led to vast research in recent years because it can…

Machine Learning · Computer Science 2020-12-25 Ruqi Bai , Saurabh Bagchi , David I. Inouye

Recent work has shown deep neural networks (DNNs) to be highly susceptible to well-designed, small perturbations at the input layer, or so-called adversarial examples. Taking images as an example, such distortions are often imperceptible,…

Machine Learning · Computer Science 2015-04-13 Shixiang Gu , Luca Rigazio

Traditional oversampling methods are generally employed to handle class imbalance in datasets. This oversampling approach is independent of the classifier; thus, it does not offer an end-to-end solution. To overcome this, we propose a…

Machine Learning · Computer Science 2021-08-25 Tanmoy Dam , Md Meftahul Ferdaus , Sreenatha G. Anavatti , Senthilnath Jayavelu , Hussein A. Abbass

Any autoencoder network can be turned into a generative model by imposing an arbitrary prior distribution on its hidden code vector. Variational Autoencoder (VAE) [2] uses a KL divergence penalty to impose the prior, whereas Adversarial…

Machine Learning · Computer Science 2018-07-23 Mahdi Azarafrooz

Adversarial Training (AT) has been found to substantially improve the robustness of deep learning classifiers against adversarial attacks. AT involves obtaining robustness by including adversarial examples in training a classifier. Most…

Machine Learning · Computer Science 2023-07-17 Olukorede Fakorede , Ashutosh Kumar Nirala , Modeste Atsague , Jin Tian

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

Machine Learning · Computer Science 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

In order to devise an anomaly detection model using only normal training data, an autoencoder (AE) is typically trained to reconstruct the data. As a result, the AE can extract normal representations in its latent space. During test time,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Marcella Astrid , Muhammad Zaigham Zaheer , Seung-Ik Lee

Handling contaminated data poses a critical challenge in anomaly detection, as traditional models assume training on purely normal data. Conventional methods mitigate contamination by relying on fixed contamination ratios, but discrepancies…

Machine Learning · Computer Science 2025-11-27 Jungi Lee , Jungkwon Kim , Chi Zhang , Kwangsun Yoo , Seok-Joo Byun

The conditional average treatment effect (CATE) is widely used in personalized medicine to inform therapeutic decisions. However, state-of-the-art methods for CATE estimation (so-called meta-learners) often perform poorly in the presence of…

Machine Learning · Computer Science 2026-03-12 Valentyn Melnychuk , Dennis Frauen , Jonas Schweisthal , Stefan Feuerriegel