English
Related papers

Related papers: Improving Relation Extraction by Pre-trained Langu…

200 papers

The relation extraction (RE) in complex scenarios faces challenges such as diverse relation types and ambiguous relations between entities within a single sentence, leading to the poor performance of pure "text-in, text-out" language models…

Computation and Language · Computer Science 2024-09-04 Yuchen Shi , Guochao Jiang , Tian Qiu , Deqing Yang

Implicit discourse relations bind smaller linguistic units into coherent texts. Automatic sense prediction for implicit relations is hard, because it requires understanding the semantics of the linked arguments. Furthermore, annotated…

Computation and Language · Computer Science 2022-10-21 Murali Raghu Babu Balusu , Yangfeng Ji , Jacob Eisenstein

Due to the semantic complexity of the Relation extraction (RE) task, obtaining high-quality human labelled data is an expensive and noisy process. To improve the sample efficiency of the models, semi-supervised learning (SSL) methods aim to…

Computation and Language · Computer Science 2023-06-21 Komal K. Teru

Sentence-level relation extraction mainly aims to classify the relation between two entities in a sentence. The sentence-level relation extraction corpus often contains data that are difficult for the model to infer or noise data. In this…

Computation and Language · Computer Science 2021-08-05 Seongsik Park , Harksoo Kim

We introduce SpERT, an attention model for span-based joint entity and relation extraction. Our key contribution is a light-weight reasoning on BERT embeddings, which features entity recognition and filtering, as well as relation…

Computation and Language · Computer Science 2021-06-30 Markus Eberts , Adrian Ulges

Text recognition is a long-standing research problem for document digitalization. Existing approaches are usually built based on CNN for image understanding and RNN for char-level text generation. In addition, another language model is…

Computation and Language · Computer Science 2022-09-07 Minghao Li , Tengchao Lv , Jingye Chen , Lei Cui , Yijuan Lu , Dinei Florencio , Cha Zhang , Zhoujun Li , Furu Wei

Recent research efforts have explored the potential of leveraging natural language inference (NLI) techniques to enhance relation extraction (RE). In this vein, we introduce MetaEntailRE, a novel adaptation method that harnesses NLI…

Computation and Language · Computer Science 2025-03-10 William Hogan , Jingbo Shang

Speech emotion recognition is a challenging task and an important step towards more natural human-machine interaction. We show that pre-trained language models can be fine-tuned for text emotion recognition, achieving an accuracy of 69.5%…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-06 Verena Heusser , Niklas Freymuth , Stefan Constantin , Alex Waibel

Unsupervised relation extraction (URE) aims to extract relations between named entities from raw text without requiring manual annotations or pre-existing knowledge bases. In recent studies of URE, researchers put a notable emphasis on…

Computation and Language · Computer Science 2023-12-04 Qing Wang , Kang Zhou , Qiao Qiao , Yuepei Li , Qi Li

Pre-trained Transformer language models (LM) have become go-to text representation encoders. Prior research fine-tunes deep LMs to encode text sequences such as sentences and passages into single dense vector representations for efficient…

Computation and Language · Computer Science 2021-09-22 Luyu Gao , Jamie Callan

Proto-form reconstruction has been a painstaking process for linguists. Recently, computational models such as RNN and Transformers have been proposed to automate this process. We take three different approaches to improve upon previous…

Computation and Language · Computer Science 2024-04-25 Chenxuan Cui , Ying Chen , Qinxin Wang , David R. Mortensen

Labeling explicit discourse relations is one of the most challenging sub-tasks of the shallow discourse parsing where the goal is to identify the discourse connectives and the boundaries of their arguments. The state-of-the-art models…

Computation and Language · Computer Science 2020-06-23 Murathan Kurfalı

Language models with the Transformers structure have shown great performance in natural language processing. However, there still poses problems when fine-tuning pre-trained language models on downstream tasks, such as over-fitting or…

Computation and Language · Computer Science 2023-05-12 Hongyi Yuan , Zheng Yuan , Chuanqi Tan , Fei Huang , Songfang Huang

Multimodal relation extraction (MRE) is the task of identifying the semantic relationships between two entities based on the context of the sentence image pair. Existing retrieval-augmented approaches mainly focused on modeling the…

Computation and Language · Computer Science 2023-05-26 Xuming Hu , Zhijiang Guo , Zhiyang Teng , Irwin King , Philip S. Yu

Relation extraction (RE) aims to identify semantic relationships between entities within text. Despite considerable advancements, existing models predominantly require extensive annotated training data, which is both costly and…

Computation and Language · Computer Science 2024-10-28 Sizhe Zhou , Yu Meng , Bowen Jin , Jiawei Han

This paper describes our system developed for the SemEval-2023 Task 12 "Sentiment Analysis for Low-resource African Languages using Twitter Dataset". Sentiment analysis is one of the most widely studied applications in natural language…

Computation and Language · Computer Science 2024-01-08 Mingyang Wang , Heike Adel , Lukas Lange , Jannik Strötgen , Hinrich Schütze

Joint entity-relation extraction (JERE) identifies both entities and their relationships simultaneously. Traditional machine-learning based approaches to performing this task require a large corpus of annotated data and lack the ability to…

Artificial Intelligence · Computer Science 2026-01-09 Trang Tran , Trung Hoang Le , Huiping Cao , Tran Cao Son

Knowledge is a formal way of understanding the world, providing a human-level cognition and intelligence for the next-generation artificial intelligence (AI). One of the representations of knowledge is semantic relations between entities.…

Computation and Language · Computer Science 2021-02-09 Hailin Wang , Ke Qin , Rufai Yusuf Zakari , Guoming Lu , Jin Yin

Generative relation extraction (RE) commonly involves first reformulating RE as a linguistic modeling problem easily tackled with pre-trained language models (PLM) and then fine-tuning a PLM with supervised cross-entropy loss. Although…

Computation and Language · Computer Science 2025-01-07 Jiaxin Duan , Fengyu Lu , Junfei Liu

A principal barrier to training temporal relation extraction models in new domains is the lack of varied, high quality examples and the challenge of collecting more. We present a method of automatically collecting distantly-supervised…

Computation and Language · Computer Science 2021-09-16 Xinyu Zhao , Shih-ting Lin , Greg Durrett