English
Related papers

Related papers: Adaptive perturbation adversarial training: based …

200 papers

Adversarial training is one of the most effective defenses against adversarial attacks, but it incurs a high computational cost. In this study, we present the first theoretical analysis suggesting that adversarially pretrained transformers…

Machine Learning · Computer Science 2026-03-03 Soichiro Kumano , Hiroshi Kera , Toshihiko Yamasaki

Automatic music transcription is considered to be one of the hardest problems in music information retrieval, yet recent deep learning approaches have achieved substantial improvements on transcription performance. These approaches commonly…

Sound · Computer Science 2019-06-21 Jong Wook Kim , Juan Pablo Bello

Adversarial examples are carefully perturbed in-puts for fooling machine learning models. A well-acknowledged defense method against such examples is adversarial training, where adversarial examples are injected into training data to…

Machine Learning · Computer Science 2019-05-17 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Adversarial training is the industry standard for producing models that are robust to small adversarial perturbations. However, machine learning practitioners need models that are robust to other kinds of changes that occur naturally, such…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Manli Shu , Zuxuan Wu , Micah Goldblum , Tom Goldstein

Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem.…

Machine Learning · Computer Science 2022-09-07 Tanmoy Dam , Mahardhika Pratama , MD Meftahul Ferdaus , Sreenatha Anavatti , Hussein Abbas

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Anomaly detection is a critical and challenging task that aims to identify data points deviating from normal patterns and distributions within a dataset. Various methods have been proposed using a one-class-one-model approach, but these…

Machine Learning · Computer Science 2023-12-07 Jae Young Lee , Wonjun Lee , Jaehyun Choi , Yongkwi Lee , Young Seog Yoon

Recently, it has been shown that deep neural networks (DNN) are subject to attacks through adversarial samples. Adversarial samples are often crafted through adversarial perturbation, i.e., manipulating the original sample with minor…

Machine Learning · Computer Science 2018-05-18 Jingyi Wang , Jun Sun , Peixin Zhang , Xinyu Wang

Meta-learning enables a model to learn from very limited data to undertake a new task. In this paper, we study the general meta-learning with adversarial samples. We present a meta-learning algorithm, ADML (ADversarial Meta-Learner), which…

Machine Learning · Computer Science 2020-06-23 Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

Machine Learning · Computer Science 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Adversarial training based on the minimax formulation is necessary for obtaining adversarial robustness of trained models. However, it is conservative or even pessimistic so that it sometimes hurts the natural generalization. In this paper,…

Machine Learning · Computer Science 2020-09-08 Jingfeng Zhang , Xilie Xu , Bo Han , Gang Niu , Lizhen Cui , Masashi Sugiyama , Mohan Kankanhalli

The phenomenon of adversarial examples in deep learning models has caused substantial concern over their reliability. While many deep neural networks have shown impressive performance in terms of predictive accuracy, it has been shown that…

Machine Learning · Computer Science 2021-06-28 Sadia Chowdhury , Ruth Urner

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Lin Li , Michael Spratling

Despite the effectiveness in improving the robustness of neural networks, adversarial training has suffered from the natural accuracy degradation problem, i.e., accuracy on natural samples has reduced significantly. In this study, we reveal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xiaoyue Mi , Fan Tang , Yepeng Weng , Danding Wang , Juan Cao , Sheng Tang , Peng Li , Yang Liu

In this paper we study leveraging confidence information induced by adversarial training to reinforce adversarial robustness of a given adversarially trained model. A natural measure of confidence is $\|F({\bf x})\|_\infty$ (i.e. how…

Machine Learning · Computer Science 2018-10-16 Xi Wu , Uyeong Jang , Jiefeng Chen , Lingjiao Chen , Somesh Jha

A promising way to mitigate the expensive process of obtaining a high-dimensional signal is to acquire a limited number of low-dimensional measurements and solve an under-determined inverse problem by utilizing the structural prior about…

Machine Learning · Computer Science 2024-07-11 Gianluigi Silvestri , Fabio Valerio Massoli , Tribhuvanesh Orekondy , Afshin Abdi , Arash Behboodi

The ability to deploy neural networks in real-world, safety-critical systems is severely limited by the presence of adversarial examples: slightly perturbed inputs that are misclassified by the network. In recent years, several techniques…

Machine Learning · Computer Science 2018-02-21 Nicholas Carlini , Guy Katz , Clark Barrett , David L. Dill

In standard adversarial training, models are optimized to fit one-hot labels within allowable adversarial perturbation budgets. However, the ignorance of underlying distribution shifts brought by perturbations causes the problem of robust…

Machine Learning · Computer Science 2024-04-16 Yu-Yu Wu , Hung-Jui Wang , Shang-Tse Chen

Adversarial training is wildly considered as one of the most effective way to defend against adversarial examples. However, existing adversarial training methods consume unbearable time, due to the fact that they need to generate…

Machine Learning · Computer Science 2021-03-10 Yaguan Qian , Qiqi Shao , Tengteng Yao , Bin Wang , Shouling Ji , Shaoning Zeng , Zhaoquan Gu , Wassim Swaileh

Neural ranking models (NRMs) have shown great success in information retrieval (IR). But their predictions can easily be manipulated using adversarial examples, which are crafted by adding imperceptible perturbations to legitimate…

Information Retrieval · Computer Science 2023-12-19 Yu-An Liu , Ruqing Zhang , Mingkun Zhang , Wei Chen , Maarten de Rijke , Jiafeng Guo , Xueqi Cheng