English
Related papers

Related papers: Does Recommend-Revise Produce Reliable Annotations…

200 papers

Document-level relation extraction (DocRE) poses the challenge of identifying relationships between entities within a document as opposed to the traditional RE setting where a single sentence is input. Existing approaches rely on logical…

Information Retrieval · Computer Science 2024-01-23 Monika Jain , Raghava Mutharaju , Ramakanth Kavuluru , Kuldeep Singh

We propose an annotation approach that captures not only labels but also the reading process underlying annotators' decisions, e.g., what parts of the text they focus on, re-read or skim. Using this framework, we conduct a case study on the…

Computation and Language · Computer Science 2025-12-01 Karin de Langis , William Walker , Khanh Chi Le , Dongyeop Kang

Document-level Relation Extraction (DocRE) is a more challenging task compared to its sentence-level counterpart. It aims to extract relations from multiple sentences at once. In this paper, we propose a semi-supervised framework for DocRE…

Computation and Language · Computer Science 2022-03-22 Qingyu Tan , Ruidan He , Lidong Bing , Hwee Tou Ng

Relation extraction (RE) has been extensively studied due to its importance in real-world applications such as knowledge base construction and question answering. Most of the existing works train the models on either distantly supervised…

Computation and Language · Computer Science 2020-11-25 Woohwan Jung , Kyuseok Shim

Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational…

Computation and Language · Computer Science 2022-11-29 Liang Zhang , Jinsong Su , Yidong Chen , Zhongjian Miao , Zijun Min , Qingguo Hu , Xiaodong Shi

Distant supervision based methods for entity and relation extraction have received increasing popularity due to the fact that these methods require light human annotation efforts. In this paper, we consider the problem of \textit{shifted…

Computation and Language · Computer Science 2020-04-22 Daoyuan Chen , Yaliang Li , Kai Lei , Ying Shen

In recent years, distantly-supervised relation extraction has achieved a certain success by using deep neural networks. Distant Supervision (DS) can automatically generate large-scale annotated data by aligning entity pairs from Knowledge…

Computation and Language · Computer Science 2020-11-02 Tong Zhu , Haitao Wang , Junjie Yu , Xiabing Zhou , Wenliang Chen , Wei Zhang , Min Zhang

Driven by the demand for cross-sentence and large-scale relation extraction, document-level relation extraction (DocRE) has attracted increasing research interest. Despite the continuous improvement in performance, we find that existing…

Computation and Language · Computer Science 2024-06-12 Shiao Meng , Xuming Hu , Aiwei Liu , Fukun Ma , Yawen Yang , Shuang Li , Lijie Wen

In this work, we present a Web-based annotation tool `Relation Triplets Extractor' \footnote{https://abera87.github.io/annotate/} (RTE) for annotating relation triplets from the text. Relation extraction is an important task for extracting…

Computation and Language · Computer Science 2021-08-19 Ankan Mullick , Animesh Bera , Tapas Nayak

Document-level relation extraction (DocRE) is a task that focuses on identifying relations between entities within a document. However, existing DocRE models often overlook the correlation between relations and lack a quantitative analysis…

Information Retrieval · Computer Science 2023-10-23 Yusheng Huang , Zhouhan Lin

Imperfections in data annotation, known as label noise, are detrimental to the training of machine learning models and have an often-overlooked confounding effect on the assessment of model performance. Nevertheless, employing experts to…

Many datasets have been developed to train and evaluate document-level relation extraction (RE) models. Most of these are constructed using real-world data. It has been shown that RE models trained on real-world data suffer from factual…

Computation and Language · Computer Science 2024-10-16 Ali Modarressi , Abdullatif Köksal , Hinrich Schütze

Annotation guidelines used to guide the annotation of training and evaluation datasets can have a considerable impact on the quality of machine learning models. In this study, we explore the effects of annotation guidelines on the quality…

Information Retrieval · Computer Science 2018-10-15 Faiz Ali Shah , Kairit Sirts , Dietmar Pfahl

Relational understanding is critical for a number of visually-rich documents (VRDs) understanding tasks. Through multi-modal pre-training, recent studies provide comprehensive contextual representations and exploit them as prior knowledge…

Computation and Language · Computer Science 2022-05-06 Xin Li , Yan Zheng , Yiqing Hu , Haoyu Cao , Yunfei Wu , Deqiang Jiang , Yinsong Liu , Bo Ren

Automated relation extraction (RE) from biomedical literature is critical for many downstream text mining applications in both research and real-world settings. However, most existing benchmarking datasets for bio-medical RE only focus on…

Computation and Language · Computer Science 2022-07-20 Ling Luo , Po-Ting Lai , Chih-Hsuan Wei , Cecilia N Arighi , Zhiyong Lu

Large crowd-sourced datasets are often noisy and relation classification (RC) datasets are no exception. Reannotating the entire dataset is one probable solution however it is not always viable due to time and budget constraints. This paper…

Computation and Language · Computer Science 2021-12-28 Akshay Parekh , Ashish Anand , Amit Awekar

Code review generation can reduce developer effort by producing concise, reviewer-style feedback for a given code snippet or code change. However, generation-only models often produce generic or off-point reviews, while retrieval-only…

Software Engineering · Computer Science 2026-03-26 Qianru Meng , Xiao Zhang , Zhaochen Ren , Joost Visser

Distantly supervision automatically generates plenty of training samples for relation extraction. However, it also incurs two major problems: noisy labels and imbalanced training data. Previous works focus more on reducing wrongly labeled…

Computation and Language · Computer Science 2021-05-24 Chenhao Xie , Jiaqing Liang , Jingping Liu , Chengsong Huang , Wenhao Huang , Yanghua Xiao

Existing research studies on cross-sentence relation extraction in long-form multi-party conversations aim to improve relation extraction without considering the explainability of such methods. This work addresses that gap by focusing on…

Computation and Language · Computer Science 2022-10-20 Alon Albalak , Varun Embar , Yi-Lin Tuan , Lise Getoor , William Yang Wang

Relation extraction is a fundamental task in information extraction. Most existing methods have heavy reliance on annotations labeled by human experts, which are costly and time-consuming. To overcome this drawback, we propose a novel…

Computation and Language · Computer Science 2017-08-03 Liyuan Liu , Xiang Ren , Qi Zhu , Shi Zhi , Huan Gui , Heng Ji , Jiawei Han