English
Related papers

Related papers: Hybrid Attention-Based Transformer Block Model for…

200 papers

The performance of relation extraction models has increased considerably with the rise of neural networks. However, a key issue of neural relation extraction is robustness: the models do not scale well to long sentences with multiple…

Computation and Language · Computer Science 2021-04-23 Heike Adel , Jannik Strötgen

Joint entity and relation extraction is the fundamental task of information extraction, consisting of two subtasks: named entity recognition and relation extraction. However, most existing joint extraction methods suffer from issues of…

Computation and Language · Computer Science 2024-03-28 Wenjun Kong , Yamei Xia

Sentence embedding tasks are important in natural language processing (NLP), but improving their performance while keeping them reliable is still hard. This paper presents a framework that combines pseudo-label generation and model ensemble…

Computation and Language · Computer Science 2025-01-28 Ziwei Liu , Qi Zhang , Lifu Gao

The Transformer self-attention network has recently shown promising performance as an alternative to recurrent neural networks (RNNs) in end-to-end (E2E) automatic speech recognition (ASR) systems. However, the Transformer has a drawback in…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-17 Emiru Tsunoo , Yosuke Kashiwagi , Toshiyuki Kumakura , Shinji Watanabe

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

Computation and Language · Computer Science 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

Document-level relation extraction (DocRE) is the task of identifying all relations between each entity pair in a document. Evidence, defined as sentences containing clues for the relationship between an entity pair, has been shown to help…

Computation and Language · Computer Science 2023-02-20 Youmi Ma , An Wang , Naoaki Okazaki

In recent years there is a surge of interest in applying distant supervision (DS) to automatically generate training data for relation extraction (RE). In this paper, we study the problem what limits the performance of DS-trained neural…

Computation and Language · Computer Science 2019-09-11 Qinyuan Ye , Liyuan Liu , Maosen Zhang , Xiang Ren

Large language models (LLMs) have created a new paradigm for natural language processing. Despite their advancement, LLM-based methods still lag behind traditional approaches in document-level relation extraction (DocRE), a critical task…

Computation and Language · Computer Science 2024-12-10 Xingzuo Li , Kehai Chen , Yunfei Long , Min Zhang

Relation Extraction is an important sub-task of Information Extraction which has the potential of employing deep learning (DL) models with the creation of large datasets using distant supervision. In this review, we compare the…

Computation and Language · Computer Science 2017-05-11 Shantanu Kumar

Because of the inevitable cost and complexity of transformer and pre-trained models, efficiency concerns are raised for long text classification. Meanwhile, in the highly sensitive domains, e.g., healthcare and legal long-text mining,…

Computation and Language · Computer Science 2023-04-05 Yexiang Wang , Yating Zhang , Xiaozhong Liu , Changlong Sun

Cross-document relation extraction (RE) aims to identify relations between the head and tail entities located in different documents. Existing approaches typically adopt the paradigm of ``\textit{Small Language Model (SLM) + Classifier}''.…

Computation and Language · Computer Science 2026-04-21 Guoqi Ma , Liang Zhang , Hongyao Tu , Hao Fu , Hui Li , Yujie Lin , Longyue Wang , Weihua Luo , Jinsong Su

Information Extraction (IE) is crucial for converting unstructured data into structured formats like Knowledge Graphs (KGs). A key task within IE is Relation Extraction (RE), which identifies relationships between entities in text. Various…

Computation and Language · Computer Science 2024-06-25 Sefika Efeoglu , Adrian Paschke

Lack of labeled data is a main obstacle in relation extraction. Semi-supervised relation extraction (SSRE) has been proven to be a promising way for this problem through annotating unlabeled samples as additional training data. Almost all…

Computation and Language · Computer Science 2021-12-03 Wanli Li , Tieyun Qian

In Natural Language Processing(NLP), Event Temporal Relation Extraction (ETRE) is to recognize the temporal relations of two events. Prior studies have noted the importance of language models for ETRE. However, the restricted pre-trained…

Computation and Language · Computer Science 2025-08-29 Jie Zhao , Wanting Ning , Yuxiao Fei , Yubo Feng , Lishuang Li

Document-level relation extraction (DocRE) aims to extract semantic relations among entity pairs in a document. Typical DocRE methods blindly take the full document as input, while a subset of the sentences in the document, noted as the…

Computation and Language · Computer Science 2022-03-08 Yiqing Xie , Jiaming Shen , Sha Li , Yuning Mao , Jiawei Han

The remarkable capabilities of Large Language Models (LLMs) in text comprehension and generation have revolutionized Information Extraction (IE). One such advancement is in Document-level Relation Triplet Extraction (DocRTE), a critical…

Computation and Language · Computer Science 2025-04-09 Yiheng Wu , Roman Yangarber , Xian Mao

Relation extraction (RE) is a crucial task in natural language processing (NLP) that aims to identify and classify relationships between entities mentioned in text. In the financial domain, relation extraction plays a vital role in…

Computation and Language · Computer Science 2023-07-24 Pawan Kumar Rajpoot , Ankur Parikh

Transformer-based models have achieved state-of-the-art results in a wide range of natural language processing (NLP) tasks including document summarization. Typically these systems are trained by fine-tuning a large pre-trained model to the…

Computation and Language · Computer Science 2021-06-01 Potsawee Manakul , Mark J. F. Gales

Sentence-level relation extraction aims to identify the relation between two entities for a given sentence. The existing works mostly focus on obtaining a better entity representation and adopting a multi-label classifier for relation…

Computation and Language · Computer Science 2023-04-12 Jiewen Zheng , Ze Chen

Relation Extraction (RE) has attracted increasing attention, but current RE evaluation is limited to in-domain evaluation setups. Little is known on how well a RE system fares in challenging, but realistic out-of-distribution evaluation…

Computation and Language · Computer Science 2022-10-19 Elisa Bassignana , Barbara Plank