English
Related papers

Related papers: Layout-Aware Information Extraction for Document-G…

200 papers

Document-level relation extraction aims at inferring structured human knowledge from textual documents. State-of-the-art methods for this task use pre-trained language models (LMs) via fine-tuning, yet fine-tuning is computationally…

Computation and Language · Computer Science 2024-10-03 Yilmazcan Ozyurt , Stefan Feuerriegel , Ce Zhang

Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG).…

This paper introduces the DocILE benchmark with the largest dataset of business documents for the tasks of Key Information Localization and Extraction and Line Item Recognition. It contains 6.7k annotated business documents, 100k…

We introduce WordScape, a novel pipeline for the creation of cross-disciplinary, multilingual corpora comprising millions of pages with annotations for document layout detection. Relating visual and textual items on document pages has…

Businesses need to query visually rich documents (VRDs) like receipts, medical records, and insurance forms to make decisions. Existing techniques for extracting entities from VRDs struggle with new layouts or require extensive pre-training…

Artificial Intelligence · Computer Science 2024-07-10 Thanh-Dat Nguyen , Tung Do-Viet , Hung Nguyen-Duy , Tuan-Hai Luu , Hung Le , Bach Le , Patanamon , Thongtanunam

Automating information extraction from form-like documents at scale is a pressing need due to its potential impact on automating business workflows across many industries like financial services, insurance, and healthcare. The key challenge…

Machine Learning · Computer Science 2022-01-14 Beliz Gunel , Navneet Potti , Sandeep Tata , James B. Wendt , Marc Najork , Jing Xie

Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yihao Ding , Kaixuan Ren , Jiabin Huang , Siwen Luo , Soyeon Caren Han

Despite the recent broad adoption of Large Language Models (LLMs) across various domains, their potential for enriching information systems in extracting and exploring Linked Data (LD) and Resource Description Framework (RDF) triplestores…

Information Retrieval · Computer Science 2024-09-25 Omar Mussa , Omer Rana , Benoît Goossens , Pablo Orozco-Terwengel , Charith Perera

Accurately extracting structured content from PDFs is a critical first step for NLP over scientific papers. Recent work has improved extraction accuracy by incorporating elementary layout information, e.g., each token's 2D position on the…

Computation and Language · Computer Science 2022-01-06 Zejiang Shen , Kyle Lo , Lucy Lu Wang , Bailey Kuehl , Daniel S. Weld , Doug Downey

A visually rich document (VRD) utilizes visual features along with linguistic cues to disseminate information. Training a custom extractor that identifies named entities from a document requires a large number of instances of the target…

Computation and Language · Computer Science 2024-04-02 Ritesh Sarkhel , Xiaoqi Ren , Lauro Beltrao Costa , Guolong Su , Vincent Perot , Yanan Xie , Emmanouil Koukoumidis , Arnab Nandi

Document-level relation extraction (DocRE) aims to extract semantic relations among entity pairs in a document. Typical DocRE methods blindly take the full document as input, while a subset of the sentences in the document, noted as the…

Computation and Language · Computer Science 2022-03-08 Yiqing Xie , Jiaming Shen , Sha Li , Yuning Mao , Jiawei Han

Recent advancements in the area of Computer Vision with state-of-art Neural Networks has given a boost to Optical Character Recognition (OCR) accuracies. However, extracting characters/text alone is often insufficient for relevant…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Vishwanath D , Rohit Rahul , Gunjan Sehgal , Swati , Arindam Chowdhury , Monika Sharma , Lovekesh Vig , Gautam Shroff , Ashwin Srinivasan

Existing long-document question answering systems typically process texts as flat sequences or use heuristic chunking, which overlook the discourse structures that naturally guide human comprehension. We present a discourse-aware…

Information Retrieval · Computer Science 2026-05-08 Huiyao Chen , Yi Yang , Yinghui Li , Meishan Zhang , Baotian Hu , Min Zhang

Key Information Extraction (KIE) underpins the understanding of visual documents (e.g., receipts and contracts) by extracting precise semantic content and accurately capturing spatial structure. Yet existing multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Son Nguyen , Giang Nguyen , Hung Dao , Thao Do , Daeyoung Kim

Information extraction from semi-structured documents is crucial for frictionless business-to-business (B2B) communication. While machine learning problems related to Document Information Extraction (IE) have been studied for decades, many…

Information Retrieval · Computer Science 2022-06-23 Matyáš Skalický , Štěpán Šimsa , Michal Uřičář , Milan Šulc

Text Summarization is a popular task and an active area of research for the Natural Language Processing community. By definition, it requires to account for long input texts, a characteristic which poses computational challenges for neural…

Computation and Language · Computer Science 2023-01-27 Laura Nguyen , Thomas Scialom , Benjamin Piwowarski , Jacopo Staiano

Layout is a fundamental component of any graphic design. Creating large varieties of plausible document layouts can be a tedious task, requiring numerous constraints to be satisfied, including local ones relating different semantic elements…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Akshay Gadi Patil , Omri Ben-Eliezer , Or Perel , Hadar Averbuch-Elor

Dialogue-based relation extraction (DiaRE) aims to detect the structural information from unstructured utterances in dialogues. Existing relation extraction models may be unsatisfactory under such a conversational setting, due to the…

Computation and Language · Computer Science 2021-11-02 Guoshun Nan , Guoqing Luo , Sicong Leng , Yao Xiao , Wei Lu

Key Information Extraction (KIE) is aimed at extracting structured information (e.g. key-value pairs) from form-style documents (e.g. invoices), which makes an important step towards intelligent document understanding. Previous approaches…

Artificial Intelligence · Computer Science 2022-06-15 Fengbin Zhu , Chao Wang , Wenqiang Lei , Ziyang Liu , Tat Seng Chua

With the rapid development of large language models (LLMs), more and more researchers have paid attention to information extraction based on LLMs. However, there are still some spaces to improve in the existing related methods. First,…

Computation and Language · Computer Science 2026-03-24 Jiang Liu , Ge Qiu , Hao Fei , Dongdong Xie , Jinbo Li , Fei Li , Chong Teng , Donghong Ji