English
Related papers

Related papers: $\textit{BenchIE}^{FL}$ : A Manually Re-Annotated …

200 papers

With the emergence of large language models (LLMs), there is an expectation that LLMs can effectively extract explicit information from complex real-world documents (e.g., papers, reports). However, most LLMs generate paragraph-style…

Computation and Language · Computer Science 2025-10-31 Tianyun Zhong , Guozhao Mo , Yanjiang Liu , Yihan Chen , Lingdi Kong , Xuanang Chen , Yaojie Lu , Hongyu Lin , Shiwei Ye , Xianpei Han , Ben He , Le Sun

Information Extraction (IE) refers to automatically extracting structured relation tuples from unstructured texts. Common IE solutions, including Relation Extraction (RE) and open IE systems, can hardly handle cross-sentence tuples, and are…

Information Retrieval · Computer Science 2019-01-29 Lin Qiu , Hao Zhou , Yanru Qu , Weinan Zhang , Suoheng Li , Shu Rong , Dongyu Ru , Lihua Qian , Kewei Tu , Yong Yu

We build a reference for the task of Open Information Extraction, on five documents. We tentatively resolve a number of issues that arise, including inference and granularity. We seek to better pinpoint the requirements for the task. We…

Computation and Language · Computer Science 2019-08-02 William Léchelle , Fabrizio Gotti , Philippe Langlais

Document-level information extraction (IE) is a crucial task in natural language processing (NLP). This paper conducts a systematic review of recent document-level IE literature. In addition, we conduct a thorough error analysis with…

Computation and Language · Computer Science 2023-09-26 Hanwen Zheng , Sijia Wang , Lifu Huang

Event extraction (EE) is a critical direction in the field of information extraction, laying an important foundation for the construction of structured knowledge bases. EE from text has received ample research and attention for years, yet…

Multimedia · Computer Science 2024-08-26 Bin Wang , Meishan Zhang , Hao Fei , Yu Zhao , Bobo Li , Shengqiong Wu , Wei Ji , Min Zhang

Open Information Extraction (OIE) aims to extract factual relational tuples from open-domain sentences. Downstream tasks use the extracted OIE tuples as facts, without examining the certainty of these facts. However, uncertainty/speculation…

Computation and Language · Computer Science 2023-05-09 Kuicai Dong , Aixin Sun , Jung-Jae Kim , Xiaoli Li

In this paper, we aim to enhance the robustness of Universal Information Extraction (UIE) by introducing a new benchmark dataset, a comprehensive evaluation, and a feasible solution. Existing robust benchmark datasets have two key…

Computation and Language · Computer Science 2025-03-06 Jizhao Zhu , Akang Shi , Zixuan Li , Long Bai , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Information Extraction (IE) is an essential task in Natural Language Processing. Traditional methods have relied on coarse-grained extraction with simple instructions. However, with the emergence of Large Language Models (LLMs), there is a…

Computation and Language · Computer Science 2023-10-10 Jun Gao , Huan Zhao , Yice Zhang , Wei Wang , Changlong Yu , Ruifeng Xu

State of the art neural methods for open information extraction (OpenIE) usually extract triplets (or tuples) iteratively in an autoregressive or predicate-based manner in order not to produce duplicates. In this work, we propose a…

The work presented in this master thesis consists of extracting a set of events from texts written in natural language. For this purpose, we have based ourselves on the basic notions of the information extraction as well as the open…

Computation and Language · Computer Science 2019-07-03 Sihem Sahnoun

Open Information Extraction (OIE) aims to extract relational tuples from open-domain sentences. Existing OIE systems split a sentence into tokens and recognize token spans as tuple relations and arguments. We instead propose Sentence as…

Computation and Language · Computer Science 2023-05-08 Kuicai Dong , Aixin Sun , Jung-Jae Kim , Xiaoli Li

Event extraction has gained considerable interest due to its wide-ranging applications. However, recent studies draw attention to evaluation issues, suggesting that reported scores may not accurately reflect the true performance. In this…

Computation and Language · Computer Science 2024-06-07 Kuan-Hao Huang , I-Hung Hsu , Tanmay Parekh , Zhiyu Xie , Zixuan Zhang , Premkumar Natarajan , Kai-Wei Chang , Nanyun Peng , Heng Ji

Web information extraction (WIE) is the task of automatically extracting data from web pages, offering high utility for various applications. The evaluation of WIE systems has traditionally relied on benchmarks built from HTML snapshots…

Computation and Language · Computer Science 2026-03-17 Seungbin Yang , Jihwan Kim , Jaemin Choi , Dongjin Kim , Soyoung Yang , ChaeHun Park , Jaegul Choo

Open Information Extraction (OpenIE) is the task of extracting (subject, predicate, object) triples from natural language sentences. Current OpenIE systems extract all triple slots independently. In contrast, we explore the hypothesis that…

Open information extraction (Open IE) is a challenging task especially due to its brittle data basis. Most of Open IE systems have to be trained on automatically built corpus and evaluated on inaccurate test set. In this work, we first…

Computation and Language · Computer Science 2019-11-22 Junlang Zhan , Hai Zhao

Open information extraction (OIE) systems extract relations and their arguments from natural language text in an unsupervised manner. The resulting extractions are a valuable resource for downstream tasks such as knowledge base…

Computation and Language · Computer Science 2019-04-30 Kiril Gashteovski , Sebastian Wanner , Sven Hertling , Samuel Broscheit , Rainer Gemulla

While there has been substantial progress in factoid question-answering (QA), answering complex questions remains challenging, typically requiring both a large body of knowledge and inference techniques. Open Information Extraction (Open…

Artificial Intelligence · Computer Science 2017-04-20 Tushar Khot , Ashish Sabharwal , Peter Clark

Information extraction (IE) in scientific literature has facilitated many down-stream tasks. OpenIE, which does not require any relation schema but identifies a relational phrase to describe the relationship between a subject and an object,…

Computation and Language · Computer Science 2021-08-05 Joseph Kuebler , Lingbo Tong , Meng Jiang

Open Information Extraction (Open IE) systems aim to obtain relation tuples with highly scalable extraction in portable across domain by identifying a variety of relation phrases and their arguments in arbitrary sentences. The first…

Computation and Language · Computer Science 2016-07-12 Duc-Thuan Vo , Ebrahim Bagheri

Event extraction is a complex information extraction task that involves extracting events from unstructured text. Prior classification-based methods require comprehensive entity annotations for joint training, while newer generation-based…

Computation and Language · Computer Science 2024-09-05 Meiru Zhang , Yixuan Su , Zaiqiao Meng , Zihao Fu , Nigel Collier