English
Related papers

Related papers: Exposing Shallow Heuristics of Relation Extraction…

200 papers

Relation extraction (RE) is an indispensable information extraction task in several disciplines. RE models typically assume that named entity recognition (NER) is already performed in a previous step by another independent model. Several…

Computation and Language · Computer Science 2019-08-29 Tung Tran , Ramakanth Kavuluru

Knowledge-based question answering relies on the availability of facts, the majority of which cannot be found in structured sources (e.g. Wikipedia info-boxes, Wikidata). One of the major components of extracting facts from unstructured…

Computation and Language · Computer Science 2018-03-28 Christos Christodoulopoulos , Arpit Mittal

Towards real-world information extraction scenario, research of relation extraction is advancing to document-level relation extraction(DocRE). Existing approaches for DocRE aim to extract relation by encoding various information sources in…

Computation and Language · Computer Science 2022-05-24 Yangkai Du , Tengfei Ma , Lingfei Wu , Yiming Wu , Xuhong Zhang , Bo Long , Shouling Ji

Document-level relation extraction (DocRE) aims to extract relations between entities from unstructured document text. Compared to sentence-level relation extraction, it requires more complex semantic understanding from a broader text…

Computation and Language · Computer Science 2024-09-10 Yanxu Mao , Xiaohui Chen , Peipei Liu , Tiehan Cui , Zuhui Yue , Zheng Li

Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems are increasingly deployed in industry applications, yet their reliability remains hampered by challenges in detecting hallucinations. While supervised…

Computation and Language · Computer Science 2025-05-30 Julia Belikova , Konstantin Polev , Rauf Parchiev , Dmitry Simakov

Relation extraction (RE) is a standard information extraction task playing a major role in downstream applications such as knowledge discovery and question answering. Although decoder-only large language models are excelling in generative…

Computation and Language · Computer Science 2025-07-28 Yuhang Jiang , Ramakanth Kavuluru

Continual relation extraction (CRE) aims to solve the problem of catastrophic forgetting when learning a sequence of newly emerging relations. Recent CRE studies have found that catastrophic forgetting arises from the model's lack of…

Computation and Language · Computer Science 2023-10-11 Weimin Xiong , Yifan Song , Peiyi Wang , Sujian Li

Continual relation extraction (RE) aims to learn constantly emerging relations while avoiding forgetting the learned relations. Existing works store a small number of typical samples to re-train the model for alleviating forgetting.…

Computation and Language · Computer Science 2023-05-12 Wenzheng Zhao , Yuanning Cui , Wei Hu

The inherent ambiguity of cause and effect boundaries poses a challenge in evaluating causal event extraction tasks. Traditional metrics like Exact Match and BertScore poorly reflect model performance, so we trained evaluation models to…

Computation and Language · Computer Science 2024-06-28 Italo Luis da Silva , Hanqi Yan , Lin Gui , Yulan He

Relation extraction (RE) is a core task in natural language processing. Traditional approaches typically frame RE as a supervised learning problem, directly mapping context to labels-an approach that often suffers from poor out-of-domain…

Computation and Language · Computer Science 2025-08-07 Runpeng Dai , Tong Zheng , Run Yang , Kaixian Yu , Hongtu Zhu

The DocRED dataset is one of the most popular and widely used benchmarks for document-level relation extraction (RE). It adopts a recommend-revise annotation scheme so as to have a large-scale annotated dataset. However, we find that the…

Computation and Language · Computer Science 2023-06-19 Qingyu Tan , Lu Xu , Lidong Bing , Hwee Tou Ng , Sharifah Mahani Aljunied

The advent of neural-networks in NLP brought with it substantial improvements in supervised relation extraction. However, obtaining a sufficient quantity of training data remains a key challenge. In this work we propose a process for…

Computation and Language · Computer Science 2021-02-10 Matan Eyal , Asaf Amrami , Hillel Taub-Tabib , Yoav Goldberg

Sentential relation extraction (RE) is an important task in natural language processing (NLP). In this paper we propose to do sentential RE with dynamic routing in capsules. We first show that the proposed approach outperform state of the…

Computation and Language · Computer Science 2025-09-03 Ramazan Ali Bahrami , Ramin Yahyapour

Continual relation extraction (CRE) aims to continuously train a model on data with new relations while avoiding forgetting old ones. Some previous work has proved that storing a few typical samples of old relations and replaying them when…

Computation and Language · Computer Science 2022-05-24 Kang Zhao , Hua Xu , Jiangong Yang , Kai Gao

Test-Time Adaptation (TTA) has recently emerged as a promising strategy for tackling the problem of machine learning model robustness under distribution shifts by adapting the model during inference without access to any labels. Because of…

Machine Learning · Computer Science 2024-07-22 Sebastian Cygert , Damian Sójka , Tomasz Trzciński , Bartłomiej Twardowski

Many pairwise classification tasks, such as paraphrase detection and open-domain question answering, naturally have extreme label imbalance (e.g., $99.99\%$ of examples are negatives). In contrast, many recent datasets heuristically choose…

Computation and Language · Computer Science 2020-10-13 Stephen Mussmann , Robin Jia , Percy Liang

Low-shot relation extraction~(RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, which seem to be with…

Computation and Language · Computer Science 2022-03-24 Fangchao Liu , Hongyu Lin , Xianpei Han , Boxi Cao , Le Sun

In this paper, we seek to improve the faithfulness of TempRel extraction models from two perspectives. The first perspective is to extract genuinely based on contextual description. To achieve this, we propose to conduct counterfactual…

Computation and Language · Computer Science 2022-10-13 Haoyu Wang , Hongming Zhang , Yuqian Deng , Jacob R. Gardner , Dan Roth , Muhao Chen

Fine-tuning pre-trained models have achieved impressive performance on standard natural language processing benchmarks. However, the resultant model generalizability remains poorly understood. We do not know, for example, how excellent…

Computation and Language · Computer Science 2023-01-26 Luoqiu Li , Xiang Chen , Hongbin Ye , Zhen Bi , Shumin Deng , Ningyu Zhang , Huajun Chen

We present FewRel 2.0, a more challenging task to investigate two aspects of few-shot relation classification models: (1) Can they adapt to a new domain with only a handful of instances? (2) Can they detect none-of-the-above (NOTA)…

Computation and Language · Computer Science 2019-10-17 Tianyu Gao , Xu Han , Hao Zhu , Zhiyuan Liu , Peng Li , Maosong Sun , Jie Zhou