English
Related papers

Related papers: Deep Bidirectional Transformers for Relation Extra…

200 papers

Supervised deep learning requires large amounts of training data. In the context of the FIRE2019 Arabic irony detection shared task (IDAT@FIRE2019), we show how we mitigate this need by fine-tuning the pre-trained bidirectional encoders…

Computation and Language · Computer Science 2019-11-01 Chiyu Zhang , Muhammad Abdul-Mageed

In recent years, distantly-supervised relation extraction has achieved a certain success by using deep neural networks. Distant Supervision (DS) can automatically generate large-scale annotated data by aligning entity pairs from Knowledge…

Computation and Language · Computer Science 2020-11-02 Tong Zhu , Haitao Wang , Junjie Yu , Xiabing Zhou , Wenliang Chen , Wei Zhang , Min Zhang

Relation extraction (RE) has been extensively studied due to its importance in real-world applications such as knowledge base construction and question answering. Most of the existing works train the models on either distantly supervised…

Computation and Language · Computer Science 2020-11-25 Woohwan Jung , Kyuseok Shim

With an exponential explosive growth of various digital text information, it is challenging to efficiently obtain specific knowledge from massive unstructured text information. As one basic task for natural language processing (NLP),…

Computation and Language · Computer Science 2020-03-27 Yan Xiao , Yaochu Jin , Ran Cheng , Kuangrong Hao

The superior performance of supervised relation extraction (RE) methods heavily relies on a large amount of gold standard data. Recent zero-shot relation extraction methods converted the RE task to other NLP tasks and used off-the-shelf…

Computation and Language · Computer Science 2024-03-26 Tianyin Wang , Jianwei Wang , Ziqian Zeng

We introduce SpERT, an attention model for span-based joint entity and relation extraction. Our key contribution is a light-weight reasoning on BERT embeddings, which features entity recognition and filtering, as well as relation…

Computation and Language · Computer Science 2021-06-30 Markus Eberts , Adrian Ulges

To alleviate human efforts from obtaining large-scale annotations, Semi-Supervised Relation Extraction methods aim to leverage unlabeled data in addition to learning from limited samples. Existing self-training methods suffer from the…

Computation and Language · Computer Science 2021-09-13 Xuming Hu , Chenwei Zhang , Fukun Ma , Chenyao Liu , Lijie Wen , Philip S. Yu

We explore methods to extract relations between named entities from free text in an unsupervised setting. In addition to standard feature extraction, we develop a novel method to re-weight word embeddings. We alleviate the problem of…

Computation and Language · Computer Science 2018-01-23 Hady Elsahar , Elena Demidova , Simon Gottschalk , Christophe Gravier , Frederique Laforest

Contrastive learning has been used to learn a high-quality representation of the image in computer vision. However, contrastive learning is not widely utilized in natural language processing due to the lack of a general method of data…

Computation and Language · Computer Science 2021-04-29 Peng Su , Yifan Peng , K. Vijay-Shanker

Relation extraction is the task of extracting semantic relations between entities in a sentence. It is an essential part of some natural language processing tasks such as information extraction, knowledge extraction, and knowledge base…

Computation and Language · Computer Science 2020-05-15 Majid Asgari-Bidhendi , Mehrdad Nasser , Behrooz Janfada , Behrouz Minaei-Bidgoli

Relation extraction in the biomedical domain is challenging due to the lack of labeled data and high annotation costs, needing domain experts. Distant supervision is commonly used to tackle the scarcity of annotated data by automatically…

Computation and Language · Computer Science 2022-09-14 Saadullah Amin , Pasquale Minervini , David Chang , Pontus Stenetorp , Günter Neumann

A principal barrier to training temporal relation extraction models in new domains is the lack of varied, high quality examples and the challenge of collecting more. We present a method of automatically collecting distantly-supervised…

Computation and Language · Computer Science 2021-09-16 Xinyu Zhao , Shih-ting Lin , Greg Durrett

We present simple BERT-based models for relation extraction and semantic role labeling. In recent years, state-of-the-art performance has been achieved using neural models by incorporating lexical and syntactic features such as…

Computation and Language · Computer Science 2019-04-11 Peng Shi , Jimmy Lin

Unsupervised Relation Extraction (RE) aims to identify relations between entities in text, without having access to labeled data during training. This setting is particularly relevant for domain specific RE where no annotated dataset is…

Computation and Language · Computer Science 2023-04-05 Pierre-Yves Genest , Pierre-Edouard Portier , Elöd Egyed-Zsigmond , Laurent-Walter Goix

Relation extraction (RE) plays an important role in extracting knowledge from unstructured text but requires a large amount of labeled corpus. To reduce the expensive annotation efforts, semisupervised learning aims to leverage both labeled…

Computation and Language · Computer Science 2021-03-16 Yusen Lin

Distant supervision significantly reduces human efforts in building training data for many classification tasks. While promising, this technique often introduces noise to the generated training data, which can severely affect the model…

Computation and Language · Computer Science 2018-05-16 Bingfeng Luo , Yansong Feng , Zheng Wang , Zhanxing Zhu , Songfang Huang , Rui Yan , Dongyan Zhao

Understanding the meaning of text often involves reasoning about entities and their relationships. This requires identifying textual mentions of entities, linking them to a canonical concept, and discerning their relationships. These tasks…

Computation and Language · Computer Science 2019-12-04 Trapit Bansal , Pat Verga , Neha Choudhary , Andrew McCallum

We study the problem of incorporating prior knowledge into a deep Transformer-based model,i.e.,Bidirectional Encoder Representations from Transformers (BERT), to enhance its performance on semantic textual matching tasks. By probing and…

Computation and Language · Computer Science 2021-02-23 Tingyu Xia , Yue Wang , Yuan Tian , Yi Chang

Scarcity of labeled data is one of the most frequent problems faced in machine learning. This is particularly true in relation extraction in text mining, where large corpora of texts exists in many application domains, while labeling of…

Machine Learning · Computer Science 2018-07-13 Linara Adilova , Sven Giesselbach , Stefan Rüping

The performance of deep learning-based natural language processing systems is based on large amounts of labeled training data which, in the clinical domain, are not easily available or affordable. Weak supervision and in-context learning…

Computation and Language · Computer Science 2025-04-02 Enshuo Hsu , Kirk Roberts