English
Related papers

Related papers: Improving Relation Extraction by Pre-trained Langu…

200 papers

Recent work for extracting relations from texts has achieved excellent performance. However, most existing methods pay less attention to the efficiency, making it still challenging to quickly extract relations from massive or streaming text…

Computation and Language · Computer Science 2022-05-24 Guozheng Li , Xu Chen , Peng Wang , Jiafeng Xie , Qiqing Luo

We present FinTree, Financial Dataset Pretrain Transformer Encoder for Relation Extraction. Utilizing an encoder language model, we further pretrain FinTree on the financial dataset, adapting the model in financial domain tasks. FinTree…

Computation and Language · Computer Science 2023-07-27 Hyunjong Ok

Analysing the generalisation capabilities of relation extraction (RE) models is crucial for assessing whether they learn robust relational patterns or rely on spurious correlations. Our cross-dataset experiments find that RE models struggle…

Computation and Language · Computer Science 2025-12-16 Varvara Arzt , Allan Hanbury , Michael Wiegand , Gábor Recski , Terra Blevins

This article presents a systematic review of relation extraction (RE) research since the advent of Transformer-based models. Using an automated framework to collect and annotate publications, we analyze 34 surveys, 64 datasets, and 104…

Computation and Language · Computer Science 2025-11-24 Ringwald Celian , Gandon , Fabien , Faron Catherine , Michel Franck , Abi Akl Hanna

Entity and relation extraction is a key task in information extraction, where the output can be used for downstream NLP tasks. Existing approaches for entity and relation extraction tasks mainly focus on the English corpora and ignore other…

Computation and Language · Computer Science 2023-01-12 Zixiang Wang , Jian Yang , Tongliang Li , Jiaheng Liu , Ying Mo , Jiaqi Bai , Longtao He , Zhoujun Li

Relation Extraction (RE) is a crucial task in Information Extraction, which entails predicting relationships between entities within a given sentence. However, extending pre-trained RE models to other languages is challenging, particularly…

Computation and Language · Computer Science 2023-04-21 Chiaming Hsu , Changtong Zan , Liang Ding , Longyue Wang , Xiaoting Wang , Weifeng Liu , Fu Lin , Wenbin Hu

Relation Extraction (RE) is a pivotal task in automatically extracting structured information from unstructured text. In this paper, we present a multi-faceted approach that integrates representative examples and through co-set expansion.…

Computation and Language · Computer Science 2023-08-24 Yerong Li , Roxana Girju

Pre-trained transformer models shine in many natural language processing tasks and therefore are expected to bear the representation of the input sentence or text meaning. These sentence-level embeddings are also important in…

Computation and Language · Computer Science 2025-02-21 Lukas Stankevičius , Mantas Lukoševičius

Dependency trees help relation extraction models capture long-range relations between words. However, existing dependency-based models either neglect crucial information (e.g., negation) by pruning the dependency trees too aggressively, or…

Computation and Language · Computer Science 2018-09-28 Yuhao Zhang , Peng Qi , Christopher D. Manning

General-purpose pretrained sentence encoders such as BERT are not ideal for real-world conversational AI applications; they are computationally heavy, slow, and expensive to train. We propose ConveRT (Conversational Representations from…

Computation and Language · Computer Science 2020-04-30 Matthew Henderson , Iñigo Casanueva , Nikola Mrkšić , Pei-Hao Su , Tsung-Hsien Wen , Ivan Vulić

Much recent work suggests that incorporating syntax information from dependency trees can improve task-specific transformer models. However, the effect of incorporating dependency tree information into pre-trained transformer models (e.g.,…

Computation and Language · Computer Science 2021-01-28 Devendra Singh Sachan , Yuhao Zhang , Peng Qi , William Hamilton

This paper addresses a crucial challenge in retrieval-augmented generation-based relation extractors; the end-to-end training is not applicable to conventional retrieval-augmented generation due to the non-differentiable nature of instance…

Computation and Language · Computer Science 2024-10-11 Kohei Makino , Makoto Miwa , Yutaka Sasaki

Relation extraction (RE) aims to extract the relations between entity names from the textual context. In principle, textual context determines the ground-truth relation and the RE models should be able to correctly identify the relations…

Computation and Language · Computer Science 2024-05-08 Yiwei Wang , Bryan Hooi , Fei Wang , Yujun Cai , Yuxuan Liang , Wenxuan Zhou , Jing Tang , Manjuan Duan , Muhao Chen

Relation Extraction (RE) is a foundational task of natural language processing. RE seeks to transform raw, unstructured text into structured knowledge by identifying relational information between entity pairs found in text. RE has numerous…

Computation and Language · Computer Science 2022-07-19 William Hogan

Continual relation extraction (RE) aims to learn constantly emerging relations while avoiding forgetting the learned relations. Existing works store a small number of typical samples to re-train the model for alleviating forgetting.…

Computation and Language · Computer Science 2023-05-12 Wenzheng Zhao , Yuanning Cui , Wei Hu

Automatic relationship extraction (RE) from biomedical literature is critical for managing the vast amount of scientific knowledge produced each year. In recent years, utilizing pre-trained language models (PLMs) has become the prevalent…

Computation and Language · Computer Science 2025-11-04 Mario Sänger , Ulf Leser

Transformer-based pre-trained language models have proven to be effective for learning contextualized language representation. However, current approaches only take advantage of the output of the encoder's final layer when fine-tuning the…

Computation and Language · Computer Science 2020-04-30 Junjie Yang , Hai Zhao

Recent works in relation extraction (RE) have achieved promising benchmark accuracy; however, our adversarial attack experiments show that these works excessively rely on entities, making their generalization capability questionable. To…

Computation and Language · Computer Science 2024-04-05 Dawei Li , William Hogan , Jingbo Shang

Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational…

Computation and Language · Computer Science 2022-11-29 Liang Zhang , Jinsong Su , Yidong Chen , Zhongjian Miao , Zijun Min , Qingguo Hu , Xiaodong Shi

Continual relation extraction (CRE) requires the model to continually learn new relations from class-incremental data streams. In this paper, we propose a Frustratingly easy but Effective Approach (FEA) method with two learning stages for…

Computation and Language · Computer Science 2022-09-02 Peiyi Wang , Yifan Song , Tianyu Liu , Rundong Gao , Binghuai Lin , Yunbo Cao , Zhifang Sui