English
Related papers

Related papers: Free Lunch for Domain Adversarial Training: Enviro…

200 papers

Collecting large training datasets, annotated with high-quality labels, is costly and time-consuming. This paper proposes a novel framework for training deep convolutional neural networks from noisy labeled datasets that can be obtained…

Machine Learning · Computer Science 2017-11-06 Arash Vahdat

The task of image segmentation is inherently noisy due to ambiguities regarding the exact location of boundaries between anatomical structures. We argue that this information can be extracted from the expert annotations at no extra cost,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Mobarakol Islam , Ben Glocker

In this study, we propose a novel noise adaptive speech enhancement (SE) system, which employs a domain adversarial training (DAT) approach to tackle the issue of a noise type mismatch between the training and testing conditions. Such a…

Sound · Computer Science 2019-07-02 Chien-Feng Liao , Yu Tsao , Hung-Yi Lee , Hsin-Min Wang

Adversarial training is one of the most effective methods for enhancing model robustness. Recent approaches incorporate adversarial distillation in adversarial training architectures. However, we notice two scenarios of defense methods that…

Machine Learning · Computer Science 2024-08-26 Zhenyu Liu , Haoran Duan , Huizhi Liang , Yang Long , Vaclav Snasel , Guiseppe Nicosia , Rajiv Ranjan , Varun Ojha

We study Label Smoothing (LS), a widely used regularization technique, in the context of neural learning to rank (L2R) models. LS combines the ground-truth labels with a uniform distribution, encouraging the model to be less confident in…

Information Retrieval · Computer Science 2020-12-17 Gustavo Penha , Claudia Hauff

Noisy labels (NL) and adversarial examples both undermine trained models, but interestingly they have hitherto been studied independently. A recent adversarial training (AT) study showed that the number of projected gradient descent (PGD)…

Machine Learning · Computer Science 2021-02-10 Jianing Zhu , Jingfeng Zhang , Bo Han , Tongliang Liu , Gang Niu , Hongxia Yang , Mohan Kankanhalli , Masashi Sugiyama

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…

Machine Learning · Statistics 2019-08-05 Sunil Thulasidasan , Tanmoy Bhattacharya , Jeff Bilmes , Gopinath Chennupati , Jamal Mohd-Yusof

Semi-supervised domain adaptation (SSDA) methods have demonstrated great potential in large-scale image classification tasks when massive labeled data are available in the source domain but very few labeled samples are provided in the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Zhiyong Huang , Kekai Sheng , Weiming Dong , Xing Mei , Chongyang Ma , Feiyue Huang , Dengwen Zhou , Changsheng Xu

To achieve state-of-the-art performance, one still needs to train NER models on large-scale, high-quality annotated data, an asset that is both costly and time-intensive to accumulate. In contrast, real-world applications often resort to…

Computation and Language · Computer Science 2023-10-26 Zhendong Chu , Ruiyi Zhang , Tong Yu , Rajiv Jain , Vlad I Morariu , Jiuxiang Gu , Ani Nenkova

Sequence labeling systems should perform reliably not only under ideal conditions but also with corrupted inputs - as these systems often process user-generated text or follow an error-prone upstream component. To this end, we formulate the…

Computation and Language · Computer Science 2020-05-15 Marcin Namysl , Sven Behnke , Joachim Köhler

Datasets with significant proportions of noisy (incorrect) class labels present challenges for training accurate Deep Neural Networks (DNNs). We propose a new perspective for understanding DNN generalization for such datasets, by…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Xingjun Ma , Yisen Wang , Michael E. Houle , Shuo Zhou , Sarah M. Erfani , Shu-Tao Xia , Sudanthi Wijewickrema , James Bailey

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network…

Machine Learning · Computer Science 2020-07-07 Weizhi Li , Gautam Dasarathy , Visar Berisha

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

We study the problem of training named entity recognition (NER) models using only distantly-labeled data, which can be automatically obtained by matching entity mentions in the raw text with entity types in a knowledge base. The biggest…

Computation and Language · Computer Science 2021-09-13 Yu Meng , Yunyi Zhang , Jiaxin Huang , Xuan Wang , Yu Zhang , Heng Ji , Jiawei Han

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

Machine Learning · Computer Science 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an…

Machine Learning · Computer Science 2022-09-07 Chen-Chen Zong , Zheng-Tao Cao , Hong-Tao Guo , Yun Du , Ming-Kun Xie , Shao-Yuan Li , Sheng-Jun Huang

While fully-supervised deep learning yields good models for urban scene semantic segmentation, these models struggle to generalize to new environments with different lighting or weather conditions for instance. In addition, producing the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Antoine Saporta , Tuan-Hung Vu , Matthieu Cord , Patrick Pérez

Accurate perception is critical for vehicle safety, with LiDAR as a key enabler in autonomous driving. To ensure robust performance across environments, sensor types, and weather conditions without costly re-annotation, domain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Weitong Kong , Zichao Zeng , Di Wen , Jiale Wei , Kunyu Peng , June Moh Goo , Jan Boehm , Rainer Stiefelhagen

Often, the data used to train ranking models is subject to label noise. For example, in web-search, labels created from clickstream data are noisy due to issues such as insufficient information in item descriptions on the SERP, query…

Information Retrieval · Computer Science 2022-08-18 Dany Haddad

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli