English
Related papers

Related papers: Introducing Adaptive Continuous Adversarial Traini…

200 papers

Adversarial attacks are a major concern in security-centered applications, where malicious actors continuously try to mislead Machine Learning (ML) models into wrongly classifying fraudulent activity as legitimate, whereas system…

Some recent works revealed that deep neural networks (DNNs) are vulnerable to so-called adversarial attacks where input examples are intentionally perturbed to fool DNNs. In this work, we revisit the DNN training process that includes…

Machine Learning · Computer Science 2018-05-15 Chang Song , Hsin-Pai Cheng , Huanrui Yang , Sicheng Li , Chunpeng Wu , Qing Wu , Hai Li , Yiran Chen

Adversarial training is an effective but time-consuming way to train robust deep neural networks that can withstand strong adversarial attacks. As a response to its inefficiency, we propose Dynamic Efficient Adversarial Training (DEAT),…

Machine Learning · Computer Science 2023-03-15 Fu Wang , Yanghao Zhang , Yanbin Zheng , Wenjie Ruan

By injecting adversarial examples into training data, adversarial training is promising for improving the robustness of deep learning models. However, most existing adversarial training approaches are based on a specific type of adversarial…

Machine Learning · Computer Science 2019-03-18 Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft

Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This…

Machine Learning · Computer Science 2019-12-06 Jonathan Uesato , Jean-Baptiste Alayrac , Po-Sen Huang , Robert Stanforth , Alhussein Fawzi , Pushmeet Kohli

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

Machine Learning · Computer Science 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

Model-agnostic meta-learning (MAML) has emerged as one of the most successful meta-learning techniques in few-shot learning. It enables us to learn a meta-initialization} of model parameters (that we call meta-model) to rapidly adapt to new…

Machine Learning · Computer Science 2021-02-23 Ren Wang , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Chuang Gan , Meng Wang

Vision Transformer (ViT) models have achieved remarkable performance across various vision tasks, with scalability being a key advantage when applied to large datasets. This scalability enables ViT models to exhibit strong generalization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Wenyun Li , Zheng Zhang , Dongmei Jiang , Yaowei Wang , Xiangyuan Lan

Adversarial training (AT) for robust representation learning and self-supervised learning (SSL) for unsupervised representation learning are two active research fields. Integrating AT into SSL, multiple prior works have accomplished a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Chaoning Zhang , Kang Zhang , Chenshuang Zhang , Axi Niu , Jiu Feng , Chang D. Yoo , In So Kweon

Existing segmentation models exhibit significant vulnerability to adversarial attacks.To improve robustness, adversarial training incorporates adversarial examples into model training. However, existing attack methods consider only global…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yufei Song , Ziqi Zhou , Menghao Deng , Yifan Hu , Shengshan Hu , Minghui Li , Leo Yu Zhang

In this work we introduce Salient Information Preserving Adversarial Training (SIP-AT), an intuitive method for relieving the robustness-accuracy trade-off incurred by traditional adversarial training. SIP-AT uses salient image regions to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Timothy Redgrave , Adam Czajka

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Adversarial training (AT) is a regularization method that can be used to improve the robustness of neural network methods by adding small perturbations in the training data. We show how to use AT for the tasks of entity recognition and…

Computation and Language · Computer Science 2019-01-15 Giannis Bekoulis , Johannes Deleu , Thomas Demeester , Chris Develder

Adversarial training has been considered an imperative component for safely deploying neural network-based applications to the real world. To achieve stronger robustness, existing methods primarily focus on how to generate strong attacks by…

Machine Learning · Computer Science 2023-09-01 Yeachan Kim , Seongyeon Kim , Ihyeok Seo , Bonggun Shin

Adversarial training (AT) is always formulated as a minimax problem, of which the performance depends on the inner optimization that involves the generation of adversarial examples (AEs). Most previous methods adopt Projected Gradient…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

Machine Learning (ML) techniques can facilitate the automation of malicious software (malware for short) detection, but suffer from evasion attacks. Many studies counter such attacks in heuristic manners, lacking theoretical guarantees and…

Cryptography and Security · Computer Science 2023-04-07 Deqiang Li , Shicheng Cui , Yun Li , Jia Xu , Fu Xiao , Shouhuai Xu

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

Machine Learning-as-a-Service systems (MLaaS) have been largely developed for cybersecurity-critical applications, such as detecting network intrusions and fake news campaigns. Despite effectiveness, their robustness against adversarial…

Cryptography and Security · Computer Science 2022-12-29 Helene Orsini , Hongyan Bao , Yujun Zhou , Xiangrui Xu , Yufei Han , Longyang Yi , Wei Wang , Xin Gao , Xiangliang Zhang

While convolutional neural networks (CNNs) have achieved excellent performances in various computer vision tasks, they often misclassify with malicious samples, a.k.a. adversarial examples. Adversarial training is a popular and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Hiroki Adachi , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi , Yasunori Ishii , Kazuki Kozuka

Adversarial training (AT) is an effective defense for large language models (LLMs) against jailbreak attacks, but performing AT on LLMs is costly. To improve the efficiency of AT for LLMs, recent studies propose continuous AT (CAT) that…

Machine Learning · Computer Science 2026-04-15 Shaopeng Fu , Di Wang