English
Related papers

Related papers: $\textit{BenchIE}^{FL}$ : A Manually Re-Annotated …

200 papers

The number of published articles in the field of materials science is growing rapidly every year. This comparatively unstructured data source, which contains a large amount of information, has a restriction on its re-usability, as the…

Computation and Language · Computer Science 2021-01-26 Souradip Guha , Ankan Mullick , Jatin Agrawal , Swetarekha Ram , Samir Ghui , Seung-Cheol Lee , Satadeep Bhattacharjee , Pawan Goyal

Business Document Information Extraction (BDIE) is the problem of transforming a blob of unstructured information (raw text, scanned documents, etc.) into a structured format that downstream systems can parse and use. It has two main tasks:…

Computation and Language · Computer Science 2024-05-31 Franz Louis Cesista , Rui Aguiar , Jason Kim , Paolo Acilo

Recent advancements in text summarization, particularly with the advent of Large Language Models (LLMs), have shown remarkable performance. However, a notable challenge persists as a substantial number of automatically-generated summaries…

Computation and Language · Computer Science 2024-09-04 Alessandro Scirè , Karim Ghonim , Roberto Navigli

In this paper, an approach for concept extraction from documents using pre-trained large language models (LLMs) is presented. Compared with conventional methods that extract keyphrases summarizing the important information discussed in a…

Computation and Language · Computer Science 2025-04-23 Ebrahim Norouzi , Sven Hertling , Harald Sack

This paper presents DWIE, the 'Deutsche Welle corpus for Information Extraction', a newly created multi-task dataset that combines four main Information Extraction (IE) annotation subtasks: (i) Named Entity Recognition (NER), (ii)…

Computation and Language · Computer Science 2021-03-10 Klim Zaporojets , Johannes Deleu , Chris Develder , Thomas Demeester

Large language models (LLMs) demonstrate robust capabilities across diverse research domains. However, their performance in universal information extraction (UIE) remains insufficient, especially when tackling structured output scenarios…

Computation and Language · Computer Science 2025-09-12 Zhongqiu Li , Shiquan Wang , Ruiyu Fang , Mengjiao Bao , Zhenhe Wu , Shuangyong Song , Yongxiang Li , Zhongjiang He

Learning template based information extraction from documents is a crucial yet difficult task. Prior template-based IE approaches assume foreknowledge of the domain templates; however, real-world IE do not have pre-defined schemas and it is…

Off-policy evaluation (OPE) holds the promise of being able to leverage large, offline datasets for both evaluating and selecting complex policies for decision making. The ability to learn offline is particularly important in many…

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI's GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been…

Computation and Language · Computer Science 2024-09-11 Ridong Han , Chaohao Yang , Tao Peng , Prayag Tiwari , Xiang Wan , Lu Liu , Benyou Wang

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI's GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been…

Computation and Language · Computer Science 2024-09-12 Ridong Han , Chaohao Yang , Tao Peng , Prayag Tiwari , Xiang Wan , Lu Liu , Benyou Wang

Large Language Models (LLMs) have made remarkable strides in various tasks. Whether LLMs are competitive few-shot solvers for information extraction (IE) tasks, however, remains an open problem. In this work, we aim to provide a thorough…

Computation and Language · Computer Science 2024-04-15 Yubo Ma , Yixin Cao , YongChing Hong , Aixin Sun

Authoring of OWL-DL ontologies is intellectually challenging and to make this process simpler, many systems accept natural language text as input. A text-based ontology authoring approach can be successful only when it is combined with an…

Artificial Intelligence · Computer Science 2017-10-02 Kevin Alex Mathews , P Sreenivasa Kumar

Document content extraction is a critical task in computer vision, underpinning the data needs of large language models (LLMs) and retrieval-augmented generation (RAG) systems. Despite recent progress, current document parsing methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Linke Ouyang , Yuan Qu , Hongbin Zhou , Jiawei Zhu , Rui Zhang , Qunshu Lin , Bin Wang , Zhiyuan Zhao , Man Jiang , Xiaomeng Zhao , Jin Shi , Fan Wu , Pei Chu , Minghao Liu , Zhenxiang Li , Chao Xu , Bo Zhang , Botian Shi , Zhongying Tu , Conghui He

As machine learning models grow more complex and their applications become more high-stakes, tools for explaining model predictions have become increasingly important. This has spurred a flurry of research in model explainability and has…

Machine Learning · Computer Science 2021-11-08 Yang Liu , Sujay Khandagale , Colin White , Willie Neiswanger

Scientific Information Extraction (ScientificIE) is a critical task that involves the identification of scientific entities and their relationships. The complexity of this task is compounded by the necessity for domain-specific knowledge…

Computation and Language · Computer Science 2023-12-27 Dong Pham , Xanh Ho , Quang-Thuy Ha , Akiko Aizawa

Unstructured documents like PDFs contain valuable structured information, but downstream systems require this data in reliable, standardized formats. LLMs are increasingly deployed to automate this extraction, making accuracy and…

Machine Learning · Computer Science 2026-02-17 Nick Ferguson , Josh Pennington , Narek Beghian , Aravind Mohan , Douwe Kiela , Sheshansh Agrawal , Thien Hang Nguyen

With rise of digital age, there is an explosion of information in the form of news, articles, social media, and so on. Much of this data lies in unstructured form and manually managing and effectively making use of it is tedious, boring and…

Computation and Language · Computer Science 2018-07-09 Sonit Singh

Open Information Extraction (OpenIE) methods extract (noun phrase, relation phrase, noun phrase) triples from text, resulting in the construction of large Open Knowledge Bases (Open KBs). The noun phrases (NPs) and relation phrases in such…

Information Retrieval · Computer Science 2019-02-04 Shikhar Vashishth , Prince Jain , Partha Talukdar

Open-ended question answering (QA) is a key task for evaluating the capabilities of large language models (LLMs). Compared to closed-ended QA, it demands longer answer statements, more nuanced reasoning processes, and diverse expressions,…

Computation and Language · Computer Science 2025-06-19 Yongqi Fan , Yating Wang , Guandong Wang , Jie Zhai , Jingping Liu , Qi Ye , Tong Ruan

Open-ended algorithms aim to learn new, interesting behaviors forever. That requires a vast environment search space, but there are thus infinitely many possible tasks. Even after filtering for tasks the current agent can learn (i.e.,…

Artificial Intelligence · Computer Science 2024-02-16 Jenny Zhang , Joel Lehman , Kenneth Stanley , Jeff Clune