English
Related papers

Related papers: BenchIE: A Framework for Multi-Faceted Fact-Based …

200 papers

When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Nikolaos Dionelis , Casper Fibaek , Luke Camilleri , Andreas Luyts , Jente Bosmans , Bertrand Le Saux

Off-policy evaluation (OPE) holds the promise of being able to leverage large, offline datasets for both evaluating and selecting complex policies for decision making. The ability to learn offline is particularly important in many…

Information Extraction (IE) from the tables present in scientific articles is challenging due to complicated tabular representations and complex embedded text. This paper presents TabLeX, a large-scale benchmark dataset comprising table…

Information Retrieval · Computer Science 2021-09-07 Harsh Desai , Pratik Kayal , Mayank Singh

Open Information Extraction (OIE) aims to extract factual relational tuples from open-domain sentences. Downstream tasks use the extracted OIE tuples as facts, without examining the certainty of these facts. However, uncertainty/speculation…

Computation and Language · Computer Science 2023-05-09 Kuicai Dong , Aixin Sun , Jung-Jae Kim , Xiaoli Li

Recent research in explainability has given rise to numerous post-hoc attribution methods aimed at enhancing our comprehension of the outputs of black-box machine learning models. However, evaluating the quality of explanations lacks a…

Machine Learning · Computer Science 2024-07-30 Samuel Sithakoul , Sara Meftah , Clément Feutry

The increased use of large language models (LLMs) across a variety of real-world applications calls for automatic tools to check the factual accuracy of their outputs, as LLMs often hallucinate. This is difficult as it requires assessing…

Computation and Language · Computer Science 2025-10-30 Hasan Iqbal , Yuxia Wang , Minghan Wang , Georgi Georgiev , Jiahui Geng , Iryna Gurevych , Preslav Nakov

The evolving landscape of explainable artificial intelligence (XAI) aims to improve the interpretability of intricate machine learning (ML) models, yet faces challenges in formalisation and empirical validation, being an inherently…

Extracting structured and grounded fact triples from raw text is a fundamental task in Information Extraction (IE). Existing IE datasets are typically collected from Wikipedia articles, using hyperlinks to link entities to the Wikidata…

Computation and Language · Computer Science 2023-06-16 Chenxi Whitehouse , Clara Vania , Alham Fikri Aji , Christos Christodoulopoulos , Andrea Pierleoni

Universal Information Extraction (UIE) has been introduced as a unified framework for various Information Extraction (IE) tasks and has achieved widespread success. Despite this, UIE models have limitations. For example, they rely heavily…

Computation and Language · Computer Science 2023-06-28 Tianshuo Peng , Zuchao Li , Lefei Zhang , Bo Du , Hai Zhao

Open Information Extraction (OpenIE) is the task of extracting (subject, predicate, object) triples from natural language sentences. Current OpenIE systems extract all triple slots independently. In contrast, we explore the hypothesis that…

Most modern Information Extraction (IE) systems are implemented as sequential taggers and only model local dependencies. Non-local and non-sequential context is, however, a valuable source of information to improve predictions. In this…

Computation and Language · Computer Science 2019-04-08 Yujie Qian , Enrico Santus , Zhijing Jin , Jiang Guo , Regina Barzilay

Information extraction from chemistry literature is vital for constructing up-to-date reaction databases for data-driven chemistry. Complete extraction requires combining information across text, tables, and figures, whereas prior work has…

Machine Learning · Computer Science 2024-04-03 Vincent Fan , Yujie Qian , Alex Wang , Amber Wang , Connor W. Coley , Regina Barzilay

Event extraction (EE) is a critical direction in the field of information extraction, laying an important foundation for the construction of structured knowledge bases. EE from text has received ample research and attention for years, yet…

Multimedia · Computer Science 2024-08-26 Bin Wang , Meishan Zhang , Hao Fei , Yu Zhao , Bobo Li , Shengqiong Wu , Wei Ji , Min Zhang

A recent state-of-the-art neural open information extraction (OpenIE) system generates extractions iteratively, requiring repeated encoding of partial outputs. This comes at a significant computational cost. On the other hand, sequence…

Computation and Language · Computer Science 2020-10-08 Keshav Kolluru , Vaibhav Adlakha , Samarth Aggarwal , Mausam , Soumen Chakrabarti

Extracting key information from scientific papers has the potential to help researchers work more efficiently and accelerate the pace of scientific progress. Over the last few years, research on Scientific Information Extraction (SciIE)…

Computation and Language · Computer Science 2023-12-19 Yuhan Li , Jian Wu , Zhiwei Yu , Börje F. Karlsson , Wei Shen , Manabu Okumura , Chin-Yew Lin

Existing neural information retrieval (IR) models have often been studied in homogeneous and narrow settings, which has considerably limited insights into their out-of-distribution (OOD) generalization capabilities. To address this, and to…

Information Retrieval · Computer Science 2021-10-22 Nandan Thakur , Nils Reimers , Andreas Rücklé , Abhishek Srivastava , Iryna Gurevych

As machine learning models grow more complex and their applications become more high-stakes, tools for explaining model predictions have become increasingly important. This has spurred a flurry of research in model explainability and has…

Machine Learning · Computer Science 2021-11-08 Yang Liu , Sujay Khandagale , Colin White , Willie Neiswanger

In this paper, we consider advancing web-scale knowledge extraction and alignment by integrating OpenIE extractions in the form of (subject, predicate, object) triples with Knowledge Bases (KB). Traditional techniques from universal schema…

Information Retrieval · Computer Science 2019-04-30 Dongxu Zhang , Subhabrata Mukherjee , Colin Lockard , Xin Luna Dong , Andrew McCallum

Event extraction is a complex information extraction task that involves extracting events from unstructured text. Prior classification-based methods require comprehensive entity annotations for joint training, while newer generation-based…

Computation and Language · Computer Science 2024-09-05 Meiru Zhang , Yixuan Su , Zaiqiao Meng , Zihao Fu , Nigel Collier

Large language models have unlocked strong multi-task capabilities from reading instructive prompts. However, recent studies have shown that existing large models still have difficulty with information extraction tasks. For example,…

Computation and Language · Computer Science 2023-04-18 Xiao Wang , Weikang Zhou , Can Zu , Han Xia , Tianze Chen , Yuansen Zhang , Rui Zheng , Junjie Ye , Qi Zhang , Tao Gui , Jihua Kang , Jingsheng Yang , Siyuan Li , Chunsai Du