English
Related papers

Related papers: A Sample-Based Training Method for Distantly Super…

200 papers

Pre-trained transformer models shine in many natural language processing tasks and therefore are expected to bear the representation of the input sentence or text meaning. These sentence-level embeddings are also important in…

Computation and Language · Computer Science 2025-02-21 Lukas Stankevičius , Mantas Lukoševičius

Automated entity relation extraction (RE) from literature provides an important source for constructing biomedical database, which is more efficient and extensible than manual curation. However, existing RE models usually ignore the…

Computation and Language · Computer Science 2019-06-25 Lixiang Hong , JinJian Lin , Jiang Tao , Jianyang Zeng

We propose a framework to improve performance of distantly-supervised relation extraction, by jointly learning to solve two related tasks: concept-instance extraction and relation extraction. We combine this with a novel use of document…

Computation and Language · Computer Science 2016-08-12 Lidong Bing , Bhuwan Dhingra , Kathryn Mazaitis , Jong Hyuk Park , William W. Cohen

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

Multiple Instance Learning (MIL) involves predicting a single label for a bag of instances, given positive or negative labels at bag-level, without accessing to label for each instance in the training phase. Since a positive bag contains…

Machine Learning · Computer Science 2020-09-09 Beomjo Shin , Junsu Cho , Hwanjo Yu , Seungjin Choi

Pre-trained language models have contributed significantly to relation extraction by demonstrating remarkable few-shot learning abilities. However, prompt tuning methods for relation extraction may still fail to generalize to those rare or…

Computation and Language · Computer Science 2023-09-20 Xiang Chen , Lei Li , Ningyu Zhang , Chuanqi Tan , Fei Huang , Luo Si , Huajun Chen

We present ReasonBert, a pre-training method that augments language models with the ability to reason over long-range relations and multiple, possibly hybrid contexts. Unlike existing pre-training methods that only harvest learning signals…

Computation and Language · Computer Science 2021-09-13 Xiang Deng , Yu Su , Alyssa Lees , You Wu , Cong Yu , Huan Sun

Distant supervised relation extraction has been successfully applied to large corpus with thousands of relations. However, the inevitable wrong labeling problem by distant supervision will hurt the performance of relation extraction. In…

Computation and Language · Computer Science 2018-11-15 Shanchan Wu , Kai Fan , Qiong Zhang

Relation extraction (RE) plays an important role in extracting knowledge from unstructured text but requires a large amount of labeled corpus. To reduce the expensive annotation efforts, semisupervised learning aims to leverage both labeled…

Computation and Language · Computer Science 2021-03-16 Yusen Lin

Few-Shot Relation Extraction (FSRE), a subtask of Relation Extraction (RE) that utilizes limited training instances, appeals to more researchers in Natural Language Processing (NLP) due to its capability to extract textual information in…

Computation and Language · Computer Science 2024-07-15 Ye Liu , Kai Zhang , Aoran Gan , Linan Yue , Feng Hu , Qi Liu , Enhong Chen

This paper proposes an efficient example sampling method for example-based word sense disambiguation systems. To construct a database of practical size, a considerable overhead for manual sense disambiguation (overhead for supervision) is…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Kentaro Inui , Takenobu Tokunaga , Hozumi Tanaka

Conventional approaches to relation extraction usually require a fixed set of pre-defined relations. Such requirement is hard to meet in many real applications, especially when new data and relations are emerging incessantly and it is…

Computation and Language · Computer Science 2019-03-27 Hong Wang , Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Shiyu Chang , William Yang Wang

Despite its popularity in sentence-level relation extraction, distantly supervised data is rarely utilized by existing work in document-level relation extraction due to its noisy nature and low information density. Among its current…

Computation and Language · Computer Science 2024-07-02 Xiangyu Lin , Weijia Jia , Zhiguo Gong

We present an approach to minimally supervised relation extraction that combines the benefits of learned representations and structured learning, and accurately predicts sentence-level relation mentions given only proposition-level…

Computation and Language · Computer Science 2019-11-20 Fan Bai , Alan Ritter

Recent years have seen rapid development in Information Extraction, as well as its subtask, Relation Extraction. Relation Extraction is able to detect semantic relations between entities in sentences. Currently, many efficient approaches…

Computation and Language · Computer Science 2024-03-19 Zhuang Li

Distant supervision assumes that any sentence containing the same entity pairs reflects identical relationships. Previous works of distantly supervised relation extraction (DSRE) task generally focus on sentence-level or bag-level…

Computation and Language · Computer Science 2022-03-03 Dongyang Li , Taolin Zhang , Nan Hu , Chengyu Wang , Xiaofeng He

Existing neural relation extraction (NRE) models rely on distant supervision and suffer from wrong labeling problems. In this paper, we propose a novel adversarial training mechanism over instances for relation extraction to alleviate the…

Computation and Language · Computer Science 2018-05-29 Xu Han , Zhiyuan Liu , Maosong Sun

Recently neural networks and multiple instance learning are both attractive topics in Artificial Intelligence related research fields. Deep neural networks have achieved great success in supervised learning problems, and multiple instance…

Machine Learning · Statistics 2020-04-08 Xinggang Wang , Yongluan Yan , Peng Tang , Xiang Bai , Wenyu Liu

Traditional Neural machine translation (NMT) involves a fixed training procedure where each sentence is sampled once during each epoch. In reality, some sentences are well-learned during the initial few epochs; however, using this approach,…

Computation and Language · Computer Science 2019-10-04 Rui Wang , Masao Utiyama , Eiichiro Sumita

Distant supervision is a widely applied approach to automatic training of relation extraction systems and has the advantage that it can generate large amounts of labelled data with minimal effort. However, this data may contain errors and…

Computation and Language · Computer Science 2015-09-15 Roland Roller , Eneko Agirre , Aitor Soroa , Mark Stevenson