中文
相关论文

相关论文: Understanding the Interaction of Adversarial Train…

200 篇论文

Adversarial training (AT) has been considered one of the most effective methods for making deep neural networks robust against adversarial attacks, while the training mechanisms and dynamics of AT remain open research problems. In this…

机器学习 · 计算机科学 2025-06-06 Zeming Wei , Yiwen Guo , Yisen Wang

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

机器学习 · 计算机科学 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Learning in the presence of label noise is a challenging yet important task: it is crucial to design models that are robust in the presence of mislabeled datasets. In this paper, we discover that a new class of loss functions called the…

机器学习 · 计算机科学 2020-02-18 Liu Ziyin , Blair Chen , Ru Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda

Making deep neural networks robust to small adversarial noises has recently been sought in many applications. Adversarial training through iterative projected gradient descent (PGD) has been established as one of the mainstream ideas to…

机器学习 · 计算机科学 2021-03-30 Zeinab Golgooni , Mehrdad Saberi , Masih Eskandar , Mohammad Hossein Rohban

We propose gradient adversarial training, an auxiliary deep learning framework applicable to different machine learning problems. In gradient adversarial training, we leverage a prior belief that in many contexts, simultaneous gradient…

机器学习 · 计算机科学 2018-06-22 Ayan Sinha , Zhao Chen , Vijay Badrinarayanan , Andrew Rabinovich

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

机器学习 · 计算机科学 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

Because deep learning is vulnerable to noisy labels, sample selection techniques, which train networks with only clean labeled data, have attracted a great attention. However, if the labels are dominantly corrupted by few classes, these…

机器学习 · 计算机科学 2021-07-16 Kyeongbo Kong , Junggi Lee , Youngchul Kwak , Young-Rae Cho , Seong-Eun Kim , Woo-Jin Song

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…

In overparametrized models, the noise in stochastic gradient descent (SGD) implicitly regularizes the optimization trajectory and determines which local minimum SGD converges to. Motivated by empirical studies that demonstrate that training…

机器学习 · 计算机科学 2021-12-07 Alex Damian , Tengyu Ma , Jason D. Lee

Learning with noisy labels (LNL) aims to ensure model generalization given a label-corrupted training set. In this work, we investigate a rarely studied scenario of LNL on fine-grained datasets (LNL-FG), which is more practical and…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Qi Wei , Lei Feng , Haoliang Sun , Ren Wang , Chenhui Guo , Yilong Yin

The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance classification performance in the presence of noisy labels,…

机器学习 · 计算机科学 2024-10-28 Bidur Khanal , Tianhong Dai , Binod Bhattarai , Cristian Linte

We introduce a Noise-based prior Learning (NoL) approach for training neural networks that are intrinsically robust to adversarial attacks. We find that the implicit generative modeling of random noise with the same loss function used…

机器学习 · 计算机科学 2019-06-04 Priyadarshini Panda , Kaushik Roy

Despite their promising performance across various natural language processing (NLP) tasks, current NLP systems are vulnerable to textual adversarial attacks. To defend against these attacks, most existing methods apply adversarial training…

计算与语言 · 计算机科学 2023-07-06 Junjie Wu , Dit-Yan Yeung

Adversarial attacks pose a severe security threat to the state-of-the-art speaker identification systems, thereby making it vital to propose countermeasures against them. Building on our previous work that used representation learning to…

音频与语音处理 · 电气工程与系统科学 2022-04-11 Sonal Joshi , Saurabh Kataria , Jesus Villalba , Najim Dehak

Artificial Intelligence systems require a through assessment of different pillars of trust, namely, fairness, interpretability, data and model privacy, reliability (safety) and robustness against against adversarial attacks. While these…

密码学与安全 · 计算机科学 2020-03-10 Vasisht Duddu , N. Rajesh Pillai , D. Vijay Rao , Valentina E. Balas

Although numerous methods to reduce the overfitting of convolutional neural networks (CNNs) exist, it is still not clear how to confidently measure the degree of overfitting. A metric reflecting the overfitting level might be, however,…

机器学习 · 计算机科学 2022-09-28 Svetlana Pavlitskaya , Joël Oswald , J. Marius Zöllner

Adversarial training (AT) is an effective technique for enhancing adversarial robustness, but it usually comes at the cost of a decline in generalization ability. Recent studies have attempted to use clean training to assist adversarial…

机器学习 · 计算机科学 2025-04-02 MingWei Zhou , Xiaobing Pei

Adversarial examples are input examples that are specifically crafted to deceive machine learning classifiers. State-of-the-art adversarial example detection methods characterize an input example as adversarial either by quantifying the…

计算机视觉与模式识别 · 计算机科学 2021-01-01 Yuhang Wu , Sunpreet S. Arora , Yanhong Wu , Hao Yang

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

机器学习 · 计算机科学 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Learning with Noisy Labels (LNL) aims to improve the model generalization when facing data with noisy labels, and existing methods generally assume that noisy labels come from known classes, called closed-set noise. However, in real-world…

机器学习 · 计算机科学 2025-01-22 Linchao Pan , Can Gao , Jie Zhou , Jinbao Wang