English
Related papers

Related papers: Manual Evaluation Matters: Reviewing Test Protocol…

200 papers

Document-level relation extraction aims to categorize the association between any two entities within a document. We find that previous methods for document-level relation extraction are ineffective in exploiting the full potential of large…

Computation and Language · Computer Science 2024-06-11 Chufan Gao , Xuan Wang , Jimeng Sun

In industry deep learning application, our manually labeled data has a certain number of noisy data. To solve this problem and achieve more than 90 score in dev dataset, we present a simple method to find the noisy data and re-label the…

Machine Learning · Computer Science 2025-03-20 Tong Guo

Recent research efforts have explored the potential of leveraging natural language inference (NLI) techniques to enhance relation extraction (RE). In this vein, we introduce MetaEntailRE, a novel adaptation method that harnesses NLI…

Computation and Language · Computer Science 2025-03-10 William Hogan , Jingbo Shang

Recently, various encoder-only and encoder-decoder pre-trained models like BERT and T5 have been applied to automatic essay scoring (AES) as small language models. However, existing studies have primarily treated this task akin to a…

Computation and Language · Computer Science 2024-07-22 Ali Ghiasvand Mohammadkhani

Data verification, the process of labeling data items as correct or incorrect, is a preprocessing step that may critically affect the quality of results in data-driven pipelines. Despite recent advances, verification can still produce…

Databases · Computer Science 2026-03-10 Ran Schreiber , Yael Amsterdamer

Relation extraction is a critical task in the field of natural language processing with numerous real-world applications. Existing research primarily focuses on monolingual relation extraction or cross-lingual enhancement for relation…

Artificial Intelligence · Computer Science 2024-03-26 Lingxing Kong , Yougang Chu , Zheng Ma , Jianbing Zhang , Liang He , Jiajun Chen

TACRED is one of the largest and most widely used sentence-level relation extraction datasets. Proposed models that are evaluated using this dataset consistently set new state-of-the-art performance. However, they still exhibit large error…

Computation and Language · Computer Science 2021-04-20 George Stoica , Emmanouil Antonios Platanios , Barnabás Póczos

Using Large Language Models (LLMs) to generate training data can potentially be a preferable way to improve zero or few-shot NLP tasks. However, many problems remain to be investigated for this direction. For the task of Relation Extraction…

Computation and Language · Computer Science 2025-05-30 Zexuan Li , Hongliang Dai , Piji Li

Radiologists are in short supply globally, and deep learning models offer a promising solution to address this shortage as part of clinical decision-support systems. However, training such models often requires expensive and time-consuming…

Computation and Language · Computer Science 2023-07-10 Alessandro Wollek , Philip Haitzer , Thomas Sedlmeyr , Sardi Hyska , Johannes Rueckel , Bastian Sabel , Michael Ingrisch , Tobias Lasser

Dialogue relation extraction (DRE) aims to extract relations between two arguments within a dialogue, which is more challenging than standard RE due to the higher person pronoun frequency and lower information density in dialogues. However,…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Zijie Xu , Ziyu Shang , Jiajun Liu , Ke Ji , Yikai Guo

Unsupervised Relation Extraction (RE) aims to identify relations between entities in text, without having access to labeled data during training. This setting is particularly relevant for domain specific RE where no annotated dataset is…

Computation and Language · Computer Science 2023-04-05 Pierre-Yves Genest , Pierre-Edouard Portier , Elöd Egyed-Zsigmond , Laurent-Walter Goix

Relation extraction in the biomedical domain is challenging due to the lack of labeled data and high annotation costs, needing domain experts. Distant supervision is commonly used to tackle the scarcity of annotated data by automatically…

Computation and Language · Computer Science 2022-09-14 Saadullah Amin , Pasquale Minervini , David Chang , Pontus Stenetorp , Günter Neumann

Existing distantly supervised relation extractors usually rely on noisy data for both model training and evaluation, which may lead to garbage-in-garbage-out systems. To alleviate the problem, we study whether a small clean dataset could…

Computation and Language · Computer Science 2022-09-15 Yufang Liu , Ziyin Huang , Yijun Wang , Changzhi Sun , Man Lan , Yuanbin Wu , Xiaofeng Mou , Ding Wang

Relation extraction (RE) aims to identify semantic relationships between entities within text. Despite considerable advancements, existing models predominantly require extensive annotated training data, which is both costly and…

Computation and Language · Computer Science 2024-10-28 Sizhe Zhou , Yu Meng , Bowen Jin , Jiawei Han

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

In natural language, often multiple entities appear in the same text. However, most previous works in Relation Extraction (RE) limit the scope to identifying the relation between two entities at a time. Such an approach induces a quadratic…

Computation and Language · Computer Science 2020-10-13 Zhijing Jin , Yongyi Yang , Xipeng Qiu , Zheng Zhang

With the rapid development of deep learning technologies, the field of machine translation has witnessed significant progress, especially with the advent of large language models (LLMs) that have greatly propelled the advancement of…

Computation and Language · Computer Science 2025-04-22 Jiaxin GUO , Xiaoyu Chen , Zhiqiang Rao , Jinlong Yang , Zongyao Li , Hengchao Shang , Daimeng Wei , Hao Yang

The increasing availability of biomedical data is helping to design more robust deep learning (DL) algorithms to analyze biomedical samples. Currently, one of the main limitations to train DL algorithms to perform a specific task is the…

Dataset distillation aims to generate compact synthetic datasets that enable models trained on them to achieve performance comparable to those trained on full real datasets, while substantially reducing storage and computational costs.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Chenyang Zhu , Bin Chen , Yaowei Wang

Distant supervision (DS) aims to generate large-scale heuristic labeling corpus, which is widely used for neural relation extraction currently. However, it heavily suffers from noisy labeling and long-tail distributions problem. Many…

Computation and Language · Computer Science 2021-02-03 Jianing Wang