中文
相关论文

相关论文: Combining Distant and Direct Supervision for Neura…

200 篇论文

In this paper, we address two different types of noise in information extraction models: noise from distant supervision and noise from pipeline input features. Our target tasks are entity typing and relation extraction. For the first noise…

计算与语言 · 计算机科学 2017-01-11 Yadollah Yaghoobzadeh , Heike Adel , Hinrich Schütze

Relation extraction has been widely studied to extract new relational facts from open corpus. Previous relation extraction methods are faced with the problem of wrong labels and noisy data, which substantially decrease the performance of…

信息检索 · 计算机科学 2018-05-01 Dongdong Yang , Senzhang Wang , Zhoujun Li

Relation extraction is an important task in structuring content of text data, and becomes especially challenging when learning with weak supervision---where only a limited number of labeled sentences are given and a large number of…

计算与语言 · 计算机科学 2019-02-26 Hongtao Lin , Jun Yan , Meng Qu , Xiang Ren

Fact triples are a common form of structured knowledge used within the biomedical domain. As the amount of unstructured scientific texts continues to grow, manual annotation of these texts for the task of relation extraction becomes…

计算与语言 · 计算机科学 2020-05-27 Saadullah Amin , Katherine Ann Dunfield , Anna Vechkaeva , Günter Neumann

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

机器学习 · 计算机科学 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

Pattern-based labeling methods have achieved promising results in alleviating the inevitable labeling noises of distantly supervised neural relation extraction. However, these methods require significant expert labor to write…

计算与语言 · 计算机科学 2019-06-11 Shun Zheng , Xu Han , Yankai Lin , Peilin Yu , Lu Chen , Ling Huang , Zhiyuan Liu , Wei Xu

To achieve state-of-the-art performance, one still needs to train NER models on large-scale, high-quality annotated data, an asset that is both costly and time-intensive to accumulate. In contrast, real-world applications often resort to…

计算与语言 · 计算机科学 2023-10-26 Zhendong Chu , Ruiyi Zhang , Tong Yu , Rajiv Jain , Vlad I Morariu , Jiuxiang Gu , Ani Nenkova

Practical natural language processing (NLP) tasks are commonly long-tailed with noisy labels. Those problems challenge the generalization and robustness of complex models such as Deep Neural Networks (DNNs). Some commonly used resampling…

计算与语言 · 计算机科学 2023-05-04 Sunyi Chi , Bo Dong , Yiming Xu , Zhenyu Shi , Zheng Du

Attention mechanism in sequence-to-sequence models is designed to model the alignments between acoustic features and output tokens in speech recognition. However, attention weights produced by models trained end to end do not always…

音频与语音处理 · 电气工程与系统科学 2022-04-27 Gene-Ping Yang , Hao Tang

Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Mengmeng Sheng , Zeren Sun , Tao Chen , Shuchao Pang , Yucheng Wang , Yazhou Yao

Extracting relations across large text spans has been relatively underexplored in NLP, but it is particularly important for high-value domains such as biomedicine, where obtaining high recall of the latest findings is crucial for practical…

计算与语言 · 计算机科学 2021-09-14 Sheng Zhang , Cliff Wong , Naoto Usuyama , Sarthak Jain , Tristan Naumann , Hoifung Poon

ConvNets achieve good results when training from clean data, but learning from noisy labels significantly degrades performances and remains challenging. Unlike previous works constrained by many conditions, making them infeasible to real…

计算机视觉与模式识别 · 计算机科学 2019-08-21 Jiangfan Han , Ping Luo , Xiaogang Wang

Datasets with significant proportions of noisy (incorrect) class labels present challenges for training accurate Deep Neural Networks (DNNs). We propose a new perspective for understanding DNN generalization for such datasets, by…

计算机视觉与模式识别 · 计算机科学 2018-08-01 Xingjun Ma , Yisen Wang , Michael E. Houle , Shuo Zhou , Sarah M. Erfani , Shu-Tao Xia , Sudanthi Wijewickrema , James Bailey

Learning with noisy labels has become an effective strategy for enhancing the robustness of models, which enables models to better tolerate inaccurate data. Existing methods either focus on optimizing the loss function to mitigate the…

人工智能 · 计算机科学 2024-06-04 Xiaming Che , Junlin Zhang , Zhuang Qi , Xin Qi

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi

Relation extraction in the biomedical domain is challenging due to the lack of labeled data and high annotation costs, needing domain experts. Distant supervision is commonly used to tackle the scarcity of annotated data by automatically…

计算与语言 · 计算机科学 2022-09-14 Saadullah Amin , Pasquale Minervini , David Chang , Pontus Stenetorp , Günter Neumann

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been successfully applied in semi-supervised learning tasks, but one…

机器学习 · 计算机科学 2023-02-17 Ran Xu , Yue Yu , Hejie Cui , Xuan Kan , Yanqiao Zhu , Joyce Ho , Chao Zhang , Carl Yang

Distantly-Supervised Named Entity Recognition (DS-NER) effectively alleviates the data scarcity problem in NER by automatically generating training samples. Unfortunately, the distant supervision may induce noisy labels, thus undermining…

计算与语言 · 计算机科学 2022-12-14 Xiaoye Qu , Jun Zeng , Daizong Liu , Zhefeng Wang , Baoxing Huai , Pan Zhou

Noisy labels are ubiquitous in real-world datasets, which poses a challenge for robustly training deep neural networks (DNNs) as DNNs usually have the high capacity to memorize the noisy labels. In this paper, we find that the test accuracy…

机器学习 · 计算机科学 2019-05-14 Pengfei Chen , Benben Liao , Guangyong Chen , Shengyu Zhang

Noisy labels, resulting from mistakes in manual labeling or webly data collecting for supervised learning, can cause neural networks to overfit the misleading information and degrade the generalization performance. Self-supervised learning…

机器学习 · 计算机科学 2021-11-02 Cheng Tan , Jun Xia , Lirong Wu , Stan Z. Li