English
Related papers

Related papers: Analysing Errors of Open Information Extraction Sy…

200 papers

Large language models can perform well on general natural language tasks, but their effectiveness is still suboptimal for information extraction (IE). Recent works indicate that the main reason lies in the lack of extensive data on IE…

Computation and Language · Computer Science 2024-07-30 Honghao Gui , Shuofei Qiao , Jintian Zhang , Hongbin Ye , Mengshu Sun , Lei Liang , Jeff Z. Pan , Huajun Chen , Ningyu Zhang

Open information extraction (OpenIE) aims to extract the schema-free triplets in the form of (\emph{subject}, \emph{predicate}, \emph{object}) from a given sentence. Compared with general information extraction (IE), OpenIE poses more…

Computation and Language · Computer Science 2024-01-23 Zhen Chen , Jingping Liu , Deqing Yang , Yanghua Xiao , Huimin Xu , Zongyu Wang , Rui Xie , Yunsen Xian

We present a benchmark of 29687 problems derived from the On-Line Encyclopedia of Integer Sequences (OEIS). Each problem expresses the equivalence of two syntactically different programs generating the same OEIS sequence. Such programs were…

Logic in Computer Science · Computer Science 2023-04-07 Thibault Gauthier , Chad E. Brown , Mikolas Janota , Josef Urban

Web information extraction (WIE) is the task of automatically extracting data from web pages, offering high utility for various applications. The evaluation of WIE systems has traditionally relied on benchmarks built from HTML snapshots…

Computation and Language · Computer Science 2026-03-17 Seungbin Yang , Jihwan Kim , Jaemin Choi , Dongjin Kim , Soyoung Yang , ChaeHun Park , Jaegul Choo

The work presented in this master thesis consists of extracting a set of events from texts written in natural language. For this purpose, we have based ourselves on the basic notions of the information extraction as well as the open…

Computation and Language · Computer Science 2019-07-03 Sihem Sahnoun

Recommender systems are among the most impactful AI applications, interacting with billions of users every day, guiding them to relevant products, services, or information tailored to their preferences. However, the research and development…

Large language models have unlocked strong multi-task capabilities from reading instructive prompts. However, recent studies have shown that existing large models still have difficulty with information extraction tasks. For example,…

Computation and Language · Computer Science 2023-04-18 Xiao Wang , Weikang Zhou , Can Zu , Han Xia , Tianze Chen , Yuansen Zhang , Rui Zheng , Junjie Ye , Qi Zhang , Tao Gui , Jihua Kang , Jingsheng Yang , Siyuan Li , Chunsai Du

Existing neural information retrieval (IR) models have often been studied in homogeneous and narrow settings, which has considerably limited insights into their out-of-distribution (OOD) generalization capabilities. To address this, and to…

Information Retrieval · Computer Science 2021-10-22 Nandan Thakur , Nils Reimers , Andreas Rücklé , Abhishek Srivastava , Iryna Gurevych

Large Language Models (LLMs) are trained on vast amounts of data, most of which is automatically scraped from the internet. This data includes encyclopedic documents that harbor a vast amount of general knowledge (e.g., Wikipedia) but also…

Large multimodal models trained on natural documents, which interleave images and text, outperform models trained on image-text pairs on various multimodal benchmarks. However, the datasets used to train these models have not been released,…

This paper introduces the DocILE benchmark with the largest dataset of business documents for the tasks of Key Information Localization and Extraction and Line Item Recognition. It contains 6.7k annotated business documents, 100k…

Open Information Extraction (OpenIE) aims to extract relational tuples from open-domain sentences. Traditional rule-based or statistical models have been developed based on syntactic structures of sentences, identified by syntactic parsers.…

Computation and Language · Computer Science 2022-12-06 Kuicai Dong , Aixin Sun , Jung-Jae Kim , Xiaoli Li

AI-powered search systems are emerging as new information gatekeepers, fundamentally transforming how users access news and information. Despite their growing influence, the citation patterns of these systems remain poorly understood. We…

Information Retrieval · Computer Science 2025-07-09 Kai-Cheng Yang

A major drawback of modern neural OpenIE systems and benchmarks is that they prioritize high coverage of information in extractions over compactness of their constituents. This severely limits the usefulness of OpenIE extractions in many…

Computation and Language · Computer Science 2022-06-13 Farima Fatahi Bayat , Nikita Bhutani , H. V. Jagadish

OpenIIR runs hundreds of LLM-driven personas as parameterised, reproducible IR research experiments. Researchers configure agents across four kinds of multi-agent study (deliberative panels, social platforms, curated recommender feeds, and…

Information Retrieval · Computer Science 2026-05-15 Saber Zerhoudi

We consider the problem of Open-world Information Extraction (Open-world IE), which extracts comprehensive entity profiles from unstructured texts. Different from the conventional closed-world setting of Information Extraction (IE),…

Computation and Language · Computer Science 2023-05-25 Keming Lu , Xiaoman Pan , Kaiqiang Song , Hongming Zhang , Dong Yu , Jianshu Chen

Event detection is a crucial information extraction task in many domains, such as Wikipedia or news. The task typically relies on trigger detection (TD) -- identifying token spans in the text that evoke specific events. While the notion of…

Computation and Language · Computer Science 2024-02-02 David Dukić , Kiril Gashteovski , Goran Glavaš , Jan Šnajder

We present the results of the Workshop on Multilingual Information Access (MIA) 2022 Shared Task, evaluating cross-lingual open-retrieval question answering (QA) systems in 16 typologically diverse languages. In this task, we adapted two…

Computation and Language · Computer Science 2022-07-05 Akari Asai , Shayne Longpre , Jungo Kasai , Chia-Hsuan Lee , Rui Zhang , Junjie Hu , Ikuya Yamada , Jonathan H. Clark , Eunsol Choi

The quickly-expanding nature of published medical literature makes it challenging for clinicians and researchers to keep up with and summarize recent, relevant findings in a timely manner. While several closed-source summarization tools…

Information Retrieval · Computer Science 2023-10-26 Alejandro Lozano , Scott L Fleming , Chia-Chun Chiang , Nigam Shah

Information extraction from chemistry literature is vital for constructing up-to-date reaction databases for data-driven chemistry. Complete extraction requires combining information across text, tables, and figures, whereas prior work has…

Machine Learning · Computer Science 2024-04-03 Vincent Fan , Yujie Qian , Alex Wang , Amber Wang , Connor W. Coley , Regina Barzilay