English
Related papers

Related papers: Learning to Denoise Distantly-Labeled Data for Ent…

200 papers

In this paper, we address two different types of noise in information extraction models: noise from distant supervision and noise from pipeline input features. Our target tasks are entity typing and relation extraction. For the first noise…

Computation and Language · Computer Science 2017-01-11 Yadollah Yaghoobzadeh , Heike Adel , Hinrich Schütze

Manual labelling of training examples is common practice in supervised learning. When the labelling task is of non-trivial difficulty, the supplied labels may not be equal to the ground-truth labels, and label noise is introduced into the…

Machine Learning · Statistics 2021-04-08 Daniel Ahfock , Geoffrey J. McLachlan

Natural language processing models often exploit spurious correlations between task-independent features and labels in datasets to perform well only within the distributions they are trained on, while not generalising to different task…

Computation and Language · Computer Science 2022-03-25 Yuxiang Wu , Matt Gardner , Pontus Stenetorp , Pradeep Dasigi

Distantly supervised named entity recognition (DS-NER) has emerged as a cheap and convenient alternative to traditional human annotation methods, enabling the automatic generation of training data by aligning text with external resources.…

Computation and Language · Computer Science 2025-05-20 Yuyang Ding , Dan Qiao , Juntao Li , Jiajie Xu , Pingfu Chao , Xiaofang Zhou , Min Zhang

The drastic increase of data quantity often brings the severe decrease of data quality, such as incorrect label annotations, which poses a great challenge for robustly training Deep Neural Networks (DNNs). Existing learning \mbox{methods}…

Machine Learning · Computer Science 2022-03-18 Qizhou Wang , Bo Han , Tongliang Liu , Gang Niu , Jian Yang , Chen Gong

Positive-Unlabeled (PU) learning aims to learn a model with rare positive samples and abundant unlabeled samples. Compared with classical binary classification, the task of PU learning is much more challenging due to the existence of many…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chengming Xu , Chen Liu , Siqian Yang , Yabiao Wang , Shijie Zhang , Lijie Jia , Yanwei Fu

High-quality pixel-level annotations are essential for the semantic segmentation of remote sensing imagery. However, such labels are expensive to obtain and often affected by noise due to the labor-intensive and time-consuming nature of…

Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Zhepei Wang , Ritwik Giri , Umut Isik , Jean-Marc Valin , Arvindh Krishnaswamy

Energy-Based Models (EBMs) assign unnormalized log-probability to data samples. This functionality has a variety of applications, such as sample synthesis, data denoising, sample restoration, outlier detection, Bayesian reasoning, and many…

Machine Learning · Statistics 2019-12-23 Zengyi Li , Yubei Chen , Friedrich T. Sommer

Corrupted labels and class imbalance are commonly encountered in practically collected training data, which easily leads to over-fitting of deep neural networks (DNNs). Existing approaches alleviate these issues by adopting a sample…

Machine Learning · Computer Science 2022-01-05 Shenwang Jiang , Jianan Li , Ying Wang , Bo Huang , Zhang Zhang , Tingfa Xu

Distant supervision for relation extraction provides uniform bag labels for each sentence inside the bag, while accurate sentence labels are important for downstream applications that need the exact relation type. Directly using bag labels…

Computation and Language · Computer Science 2021-06-23 Ruotian Ma , Tao Gui , Linyang Li , Qi Zhang , Yaqian Zhou , Xuanjing Huang

Hyperspectral image (HSI) denoising is a crucial step in enhancing the quality of HSIs. Noise modeling methods can fit noise distributions to generate synthetic HSIs to train denoising networks. However, the noise in captured HSIs is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yingkai Zhang , Tao Zhang , Jing Nie , Ying Fu

Noisy labels are ubiquitous in real-world datasets, which poses a challenge for robustly training deep neural networks (DNNs) as DNNs usually have the high capacity to memorize the noisy labels. In this paper, we find that the test accuracy…

Machine Learning · Computer Science 2019-05-14 Pengfei Chen , Benben Liao , Guangyong Chen , Shengyu Zhang

The recent success of deep learning is mostly due to the availability of big datasets with clean annotations. However, gathering a cleanly annotated dataset is not always feasible due to practical challenges. As a result, label noise is a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Görkem Algan , İlkay Ulusoy

Continuous speech can be converted into a discrete sequence by deriving discrete units from the hidden features of self-supervised learned (SSL) speech models. Although SSL models are becoming larger and trained on more data, they are often…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Jakob Poncelet , Yujun Wang , Hugo Van hamme

As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Linjuan Fan , Di Wen , Kunyu Peng , Kailun Yang , Jiaming Zhang , Ruiping Liu , Yufan Chen , Junwei Zheng , Jiamin Wu , Xudong Han , Rainer Stiefelhagen

Recently, over-parameterized deep networks, with increasingly more network parameters than training samples, have dominated the performances of modern machine learning. However, when the training data is corrupted, it has been well-known…

Machine Learning · Computer Science 2022-08-04 Sheng Liu , Zhihui Zhu , Qing Qu , Chong You

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

Large labeled training sets are the critical building blocks of supervised learning methods and are key enablers of deep learning techniques. For some applications, creating labeled training sets is the most time-consuming and expensive…

Machine Learning · Statistics 2018-12-10 Alexander Ratner , Christopher De Sa , Sen Wu , Daniel Selsam , Christopher Ré

It has been shown that machine translation models usually generate poor translations for named entities that are infrequent in the training corpus. Earlier named entity translation methods mainly focus on phonetic transliteration, which…

Computation and Language · Computer Science 2021-11-16 Junjie Hu , Hiroaki Hayashi , Kyunghyun Cho , Graham Neubig