English
Related papers

Related papers: Information Extraction from Visually Rich Document…

200 papers

Extracting information from documents usually relies on natural language processing methods working on one-dimensional sequences of text. In some cases, for example, for the extraction of key information from semi-structured documents, such…

Computation and Language · Computer Science 2021-06-29 Oliver Bensch , Mirela Popa , Constantin Spille

Visually rich documents (VRDs) are ubiquitous in daily business and life. Examples are purchase receipts, insurance policy documents, custom declaration forms and so on. In VRDs, visual and layout information is critical for document…

Information Retrieval · Computer Science 2019-03-28 Xiaojing Liu , Feiyu Gao , Qiong Zhang , Huasha Zhao

Information Extraction (IE) seeks to derive structured information from unstructured texts, often facing challenges in low-resource scenarios due to data scarcity and unseen classes. This paper presents a review of neural approaches to…

Computation and Language · Computer Science 2024-10-29 Shumin Deng , Yubo Ma , Ningyu Zhang , Yixin Cao , Bryan Hooi

The probing classifiers framework has been employed for interpreting deep neural network models for a variety of natural language processing (NLP) applications. Studies, however, have largely focused on sentencelevel NLP tasks. This work is…

Computation and Language · Computer Science 2023-10-25 Barry Wang , Xinya Du , Claire Cardie

Key Information Extraction (KIE) underpins the understanding of visual documents (e.g., receipts and contracts) by extracting precise semantic content and accurately capturing spatial structure. Yet existing multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Son Nguyen , Giang Nguyen , Hung Dao , Thao Do , Daeyoung Kim

Research in Document Intelligence and especially in Document Key Information Extraction (DocKIE) has been mainly solved as Token Classification problem. Recent breakthroughs in both natural language processing (NLP) and computer vision…

Computation and Language · Computer Science 2023-04-24 Laurent Lam , Pirashanth Ratnamogan , Joël Tang , William Vanhuffel , Fabien Caspani

Information Retrieval (IR) methods aim to identify documents relevant to a query, which have been widely applied in various natural language tasks. However, existing approaches typically consider only the textual content within documents,…

Computation and Language · Computer Science 2026-01-26 Jaewoo Lee , Joonho Ko , Jinheon Baek , Soyeong Jeong , Sung Ju Hwang

We introduce a novel approach for scanned document representation to perform field extraction. It allows the simultaneous encoding of the textual, visual and layout information in a 3-axis tensor used as an input to a segmentation model. We…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Mohamed Kerroumi , Othmane Sayem , Aymen Shabou

A real-world information extraction (IE) system for semi-structured document images often involves a long pipeline of multiple modules, whose complexity dramatically increases its development and maintenance cost. One can instead consider…

Computation and Language · Computer Science 2021-08-31 Wonseok Hwang , Hyunji Lee , Jinyeong Yim , Geewook Kim , Minjoon Seo

Information Extraction from visual documents enables convenient and intelligent assistance to end users. We present a Neighborhood-based Information Extraction (NIE) approach that uses contextual language models and pays attention to the…

Machine Learning · Computer Science 2021-08-25 Kalpa Gunaratna , Vijay Srinivasan , Sandeep Nama , Hongxia Jin

While storing invoice content as metadata to avoid paper document processing may be the future trend, almost all of daily issued invoices are still printed on paper or generated in digital formats such as PDFs. In this paper, we introduce…

Computation and Language · Computer Science 2022-08-09 Hien Thi Ha , Aleš Horák

Computer vision with state-of-the-art deep learning models has achieved huge success in the field of Optical Character Recognition (OCR) including text detection and recognition tasks recently. However, Key Information Extraction (KIE) from…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Wenwen Yu , Ning Lu , Xianbiao Qi , Ping Gong , Rong Xiao

This paper proposes LayoutLLM, a more flexible document analysis method for understanding imaged documents. Visually Rich Document Understanding tasks, such as document image classification and information extraction, have gained…

Computation and Language · Computer Science 2024-03-22 Masato Fujitake

Accurately extracting structured content from PDFs is a critical first step for NLP over scientific papers. Recent work has improved extraction accuracy by incorporating elementary layout information, e.g., each token's 2D position on the…

Computation and Language · Computer Science 2022-01-06 Zejiang Shen , Kyle Lo , Lucy Lu Wang , Bailey Kuehl , Daniel S. Weld , Doug Downey

We propose end-to-end document classification and key information extraction (KIE) for automating document processing in forms. Through accurate document classification we harness known information from templates to enhance KIE from forms.…

Information Retrieval · Computer Science 2023-06-02 Ciaran Cooney , Joana Cavadas , Liam Madigan , Bradley Savage , Rachel Heyburn , Mairead O'Cuinn

Information Extraction (IE) from the tables present in scientific articles is challenging due to complicated tabular representations and complex embedded text. This paper presents TabLeX, a large-scale benchmark dataset comprising table…

Information Retrieval · Computer Science 2021-09-07 Harsh Desai , Pratik Kayal , Mayank Singh

Extracting key information from documents, such as receipts or invoices, and preserving the interested texts to structured data is crucial in the document-intensive streamline processes of office automation in areas that includes but not…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Xiaohui Zhao , Endi Niu , Zhuo Wu , Xiaoguang Wang

The availability of metadata for scientific documents is pivotal in propelling scientific knowledge forward and for adhering to the FAIR principles (i.e. Findability, Accessibility, Interoperability, and Reusability) of research findings.…

Information Retrieval · Computer Science 2025-01-10 Zeyd Boukhers , Cong Yang

A well-designed document communicates not only through its words but also through its visual eloquence. Authors utilize aesthetic elements such as colors, fonts, graphics, and layouts to shape the perception of information. Thoughtful…

Artificial Intelligence · Computer Science 2024-03-28 Hsiu-Wei Yang , Abhinav Agrawal , Pavlos Fragkogiannis , Shubham Nitin Mulay

Keyphrase extraction from a given document is the task of automatically extracting salient phrases that best describe the document. This paper proposes a novel unsupervised graph-based ranking method to extract high-quality phrases from a…

Information Retrieval · Computer Science 2022-01-27 Venktesh V , Mukesh Mohania , Vikram Goyal