English
Related papers

Related papers: InfoAT: Improving Adversarial Training Using the I…

200 papers

Benefiting from large-scale pre-training, we have witnessed significant performance boost on the popular Visual Question Answering (VQA) task. Despite rapid progress, it remains unclear whether these state-of-the-art (SOTA) models are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Linjie Li , Jie Lei , Zhe Gan , Jingjing Liu

Adversarial training is an important topic in robust deep learning, but the community lacks attention to its practical usage. In this paper, we aim to resolve a real-world challenge, i.e., training a model on an imbalanced and noisy dataset…

Machine Learning · Computer Science 2023-12-05 Guanlin Li , Kangjie Chen , Yuan Xu , Han Qiu , Tianwei Zhang

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

In the future, powerful AI systems may be deployed in high-stakes settings, where a single failure could be catastrophic. One technique for improving AI safety in high-stakes settings is adversarial training, which uses an adversary to…

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

Crowdsourced data used in machine learning services might carry sensitive information about attributes that users do not want to share. Various methods have been proposed to minimize the potential information leakage of sensitive attributes…

Machine Learning · Computer Science 2020-10-27 Han Zhao , Jianfeng Chi , Yuan Tian , Geoffrey J. Gordon

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

Machine Learning · Computer Science 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Adversarial data augmentation has shown promise for training robust deep neural networks against unforeseen data shifts or corruptions. However, it is difficult to define heuristics to generate effective fictitious target distributions…

Machine Learning · Computer Science 2020-12-21 Long Zhao , Ting Liu , Xi Peng , Dimitris Metaxas

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

Machine Learning · Computer Science 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman

Adversarial training (AT) is an effective technique for enhancing adversarial robustness, but it usually comes at the cost of a decline in generalization ability. Recent studies have attempted to use clean training to assist adversarial…

Machine Learning · Computer Science 2025-04-02 MingWei Zhou , Xiaobing Pei

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

Machine Learning · Computer Science 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Adversarial training aims to defend against adversaries: malicious opponents whose sole aim is to harm predictive performance in any way possible. This presents a rather harsh perspective, which we assert results in unnecessarily…

Machine Learning · Computer Science 2025-06-10 Maayan Ehrenberg , Roy Ganz , Nir Rosenfeld

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

Machine Learning · Computer Science 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

Adversarial examples are a type of attack on machine learning (ML) systems which cause misclassification of inputs. Achieving robustness against adversarial examples is crucial to apply ML in the real world. While most prior work on…

Cryptography and Security · Computer Science 2020-07-16 Nico Döttling , Kathrin Grosse , Michael Backes , Ian Molloy

Vision Transformer (ViT) models have achieved remarkable performance across various vision tasks, with scalability being a key advantage when applied to large datasets. This scalability enables ViT models to exhibit strong generalization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Wenyun Li , Zheng Zhang , Dongmei Jiang , Yaowei Wang , Xiangyuan Lan

The adversarial machine learning literature is largely partitioned into evasion attacks on testing data and poisoning attacks on training data. In this work, we show that adversarial examples, originally intended for attacking pre-trained…

Machine Learning · Computer Science 2021-06-22 Liam Fowl , Micah Goldblum , Ping-yeh Chiang , Jonas Geiping , Wojtek Czaja , Tom Goldstein

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Ali Borji

Existing works have shown that fine-tuned textual transformer models achieve state-of-the-art prediction performances but are also vulnerable to adversarial text perturbations. Traditional adversarial evaluation is often done \textit{only…

Machine Learning · Computer Science 2024-07-03 Cuong Dang , Dung D. Le , Thai Le

We study the problem of knowledge tracing (KT) where the goal is to trace the students' knowledge mastery over time so as to make predictions on their future performance. Owing to the good representation capacity of deep neural networks…

Computers and Society · Computer Science 2021-08-11 Xiaopeng Guo , Zhijie Huang , Jie Gao , Mingyu Shang , Maojing Shu , Jun Sun

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie