English
Related papers

Related papers: Towards Accurate and Consistent Evaluation: A Data…

200 papers

Distantly supervised models are very popular for relation extraction since we can obtain a large amount of training data using the distant supervision method without human annotation. In distant supervision, a sentence is considered as a…

Computation and Language · Computer Science 2021-08-24 Tapas Nayak , Navonil Majumder , Soujanya Poria

Distant supervision provides a means to create a large number of weakly labeled data at low cost for relation classification. However, the resulting labeled instances are very noisy, containing data with wrong labels. Many approaches have…

Computation and Language · Computer Science 2020-10-27 Zhenzhen Li , Jian-Yun Nie , Benyou Wang , Pan Du , Yuhan Zhang , Lixin Zou , Dongsheng Li

In recent years there is a surge of interest in applying distant supervision (DS) to automatically generate training data for relation extraction (RE). In this paper, we study the problem what limits the performance of DS-trained neural…

Computation and Language · Computer Science 2019-09-11 Qinyuan Ye , Liyuan Liu , Maosen Zhang , Xiang Ren

Distantly supervised named entity recognition (DS-NER) has been proposed to exploit the automatically labeled training data instead of human annotations. The distantly annotated datasets are often noisy and contain a considerable number of…

Computation and Language · Computer Science 2023-05-23 Lu Xu , Lidong Bing , Wei Lu

Knowledge base provides a potential way to improve the intelligence of information retrieval (IR) systems, for that knowledge base has numerous relations between entities which can help the IR systems to conduct inference from one entity to…

Computation and Language · Computer Science 2019-07-29 Hai Ye , Zhunchen Luo

Distant supervision for relation extraction provides uniform bag labels for each sentence inside the bag, while accurate sentence labels are important for downstream applications that need the exact relation type. Directly using bag labels…

Computation and Language · Computer Science 2021-06-23 Ruotian Ma , Tao Gui , Linyang Li , Qi Zhang , Yaqian Zhou , Xuanjing Huang

Distant supervision has been a widely used method for neural relation extraction for its convenience of automatically labeling datasets. However, existing works on distantly supervised relation extraction suffer from the low quality of test…

Computation and Language · Computer Science 2020-10-20 Pengshuai Li , Xinsong Zhang , Weijia Jia , Wei Zhao

The noisy labeling problem has been one of the major obstacles for distant supervised relation extraction. Existing approaches usually consider that the noisy sentences are useless and will harm the model's performance. Therefore, they…

Computation and Language · Computer Science 2019-11-25 Yuming Shang

Distant Supervised Relation Extraction (DSRE) is usually formulated as a problem of classifying a bag of sentences that contain two query entities, into the predefined relation classes. Most existing methods consider those relation classes…

Computation and Language · Computer Science 2019-12-16 Yanjie Gou , Yinjie Lei , Lingqiao Liu , Pingping Zhang , Xi Peng

Distantly Supervised Named Entity Recognition (DS-NER) has attracted attention due to its scalability and ability to automatically generate labeled data. However, distant annotation introduces many mislabeled instances, limiting its…

Computation and Language · Computer Science 2025-04-08 Qi Zhang , Huitong Pan , Zhijia Chen , Longin Jan Latecki , Cornelia Caragea , Eduard Dragut

Over the last five years, research on Relation Extraction (RE) witnessed extensive progress with many new dataset releases. At the same time, setup clarity has decreased, contributing to increased difficulty of reliable empirical evaluation…

Computation and Language · Computer Science 2022-04-29 Elisa Bassignana , Barbara Plank

Distant supervision for relation extraction heavily suffers from the wrong labeling problem. To alleviate this issue in news data with the timestamp, we take a new factor time into consideration and propose a novel time-aware distant…

Computation and Language · Computer Science 2019-03-11 Tianwen Jiang , Sendong Zhao , Jing Liu , Jin-Ge Yao , Ming Liu , Bing Qin , Ting Liu , Chin-Yew Lin

Distant supervision has become the standard method for relation extraction. However, even though it is an efficient method, it does not come at no cost---The resulted distantly-supervised training samples are often very noisy. To combat the…

Computation and Language · Computer Science 2018-05-28 Pengda Qin , Weiran Xu , William Yang Wang

Relation extraction is essential for extracting and understanding biographical information in the context of digital humanities and related subjects. There is a growing interest in the community to build datasets capable of training machine…

Computation and Language · Computer Science 2024-03-28 Alistair Plum , Tharindu Ranasinghe , Christoph Purschke

Creating datasets manually by human annotators is a laborious task that can lead to biased and inhomogeneous labels. We propose a flexible, semi-automatic framework for labeling data for relation extraction. Furthermore, we provide a…

Software Engineering · Computer Science 2021-09-07 Jeremias Bohn , Jannik Fischbach , Martin Schmitt , Hinrich Schütze , Andreas Vogelsang

Distantly supervised relation extraction is widely used to extract relational facts from text, but suffers from noisy labels. Current relation extraction methods try to alleviate the noise by multi-instance learning and by providing…

Computation and Language · Computer Science 2019-06-21 Christoph Alt , Marc Hübner , Leonhard Hennig

Distant supervision leverages knowledge bases to automatically label instances, thus allowing us to train relation extractor without human annotations. However, the generated training data typically contain massive noise, and may result in…

Computation and Language · Computer Science 2018-12-31 Yujin Yuan , Liyuan Liu , Siliang Tang , Zhongfei Zhang , Yueting Zhuang , Shiliang Pu , Fei Wu , Xiang Ren

Relation Extraction (RE) has attracted increasing attention, but current RE evaluation is limited to in-domain evaluation setups. Little is known on how well a RE system fares in challenging, but realistic out-of-distribution evaluation…

Computation and Language · Computer Science 2022-10-19 Elisa Bassignana , Barbara Plank

To alleviate human efforts from obtaining large-scale annotations, Semi-Supervised Relation Extraction methods aim to leverage unlabeled data in addition to learning from limited samples. Existing self-training methods suffer from the…

Computation and Language · Computer Science 2021-09-13 Xuming Hu , Chenwei Zhang , Fukun Ma , Chenyao Liu , Lijie Wen , Philip S. Yu

The growing demand for structured knowledge has led to great interest in relation extraction, especially in cases with limited supervision. However, existing distance supervision approaches only extract relations expressed in single…

Computation and Language · Computer Science 2017-08-16 Chris Quirk , Hoifung Poon