English
Related papers

Related papers: Context-based Virtual Adversarial Training for Tex…

200 papers

Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the…

Computation and Language · Computer Science 2022-04-21 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

Event-based sensors offer significant advantages over traditional frame-based cameras, especially in scenarios involving rapid motion or challenging lighting conditions. However, event data frequently suffers from considerable noise,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Marcin Kowalczyk , Kamil Jeziorek , Tomasz Kryjak

Deep learning takes advantage of large datasets and computationally efficient training algorithms to outperform other approaches at various machine learning tasks. However, imperfections in the training phase of deep neural networks make…

Cryptography and Security · Computer Science 2015-11-25 Nicolas Papernot , Patrick McDaniel , Somesh Jha , Matt Fredrikson , Z. Berkay Celik , Ananthram Swami

Neural networks have achieved remarkable performance in computer vision, however they are vulnerable to adversarial examples. Adversarial examples are inputs that have been carefully perturbed to fool classifier networks, while appearing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Rachel Sterneck , Abhishek Moitra , Priyadarshini Panda

The keep-growing content of Web images may be the next important data source to scale up deep neural networks, which recently obtained a great success in the ImageNet classification challenge and related tasks. This prospect, however, has…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Phong D. Vo , Alexandru Ginsca , Hervé Le Borgne , Adrian Popescu

Label-noise or curated unlabeled data is used to compensate for the assumption of clean labeled data in training the conditional generative adversarial network; however, satisfying such an extended assumption is occasionally laborious or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Kai Katsumata , Duc Minh Vo , Tatsuya Harada , Hideki Nakayama

Automatic annotation of large-scale datasets can introduce noisy training data labels, which adversely affect the learning process of deep neural networks (DNNs). Consequently, Noisy Labels Learning (NLL) has become a critical research…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Maria Marrium , Arif Mahmood , Mohammed Bennamoun

We investigate two causes for adversarial vulnerability in deep neural networks: bad data and (poorly) trained models. When trained with SGD, deep neural networks essentially achieve zero training error, even in the presence of label noise,…

Machine Learning · Computer Science 2020-07-09 Amartya Sanyal , Puneet K Dokania , Varun Kanade , Philip H. S. Torr

Adversarial Training (AT), which is commonly accepted as one of the most effective approaches defending against adversarial examples, can largely harm the standard performance, thus has limited usefulness on industrial-scale production and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Xiaofeng Mao , Yuefeng Chen , Ranjie Duan , Yao Zhu , Gege Qi , Shaokai Ye , Xiaodan Li , Rong Zhang , Hui Xue

Beyond the success story of adversarial training (AT) in the recent text domain on top of pre-trained language models (PLMs), our empirical study showcases the inconsistent gains from AT on some tasks, e.g. commonsense reasoning, named…

Computation and Language · Computer Science 2023-05-09 Hongqiu Wu , Yongxiang Liu , Hanwen Shi , Hai Zhao , Min Zhang

Recently, with the help of deep learning models, significant advances have been made in different Natural Language Processing (NLP) tasks. Unfortunately, state-of-the-art models are vulnerable to noisy texts. We propose a new contextual…

Computation and Language · Computer Science 2024-03-06 Yifu Sun , Haoming Jiang

Training neural network classifiers on datasets contaminated with noisy labels significantly increases the risk of overfitting. Thus, effectively implementing Early Stopping in noisy label environments is crucial. Under ideal circumstances,…

Machine Learning · Computer Science 2024-09-12 William Toner , Amos Storkey

Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existing algorithms address…

Machine Learning · Computer Science 2023-05-16 Hanwen Deng , Weijia Zhang , Min-Ling Zhang

Noisy labels are inevitable in real-world scenarios. Due to the strong capacity of deep neural networks to memorize corrupted labels, these noisy labels can cause significant performance degradation. Existing research on mitigating the…

Machine Learning · Computer Science 2025-10-02 Xinlei Zhang , Fan Liu , Chuanyi Zhang , Fan Cheng , Yuhui Zheng

The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Chang Liu , Han Yu , Boyang Li , Zhiqi Shen , Zhanning Gao , Peiran Ren , Xuansong Xie , Lizhen Cui , Chunyan Miao

Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Uriya Pesso , Koby Bibas , Meir Feder

Training deep neural networks(DNN) with noisy labels is challenging since DNN can easily memorize inaccurate labels, leading to poor generalization ability. Recently, the meta-learning based label correction strategy is widely adopted to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

Recent advances in deep neural models allow us to build reliable named entity recognition (NER) systems without handcrafting features. However, such methods require large amounts of manually-labeled training data. There have been efforts on…

Computation and Language · Computer Science 2018-09-12 Jingbo Shang , Liyuan Liu , Xiang Ren , Xiaotao Gu , Teng Ren , Jiawei Han

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

Machine Learning · Computer Science 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

The accuracy of deep learning (e.g., convolutional neural networks) for an image classification task critically relies on the amount of labeled training data. Aiming to solve an image classification task on a new domain that lacks labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xianghong Fang , Haoli Bai , Ziyi Guo , Bin Shen , Steven Hoi , Zenglin Xu