English
Related papers

Related papers: Document Intelligence Metrics for Visually Rich Do…

200 papers

Information Extraction processes in handwritten documents tend to rely on obtaining an automatic transcription and performing Named Entity Recognition (NER) over such transcription. For this reason, in publicly available datasets, the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 David Villanova-Aparisi , Solène Tarride , Carlos-D. Martínez-Hinarejos , Verónica Romero , Christopher Kermorvant , Moisés Pastor-Gadea

Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG).…

Document Key Information Extraction (KIE) is a technology that transforms valuable information in document images into structured data, and it has become an essential function in industrial settings. However, current evaluation metrics of…

Computation and Language · Computer Science 2025-03-27 Minsoo Khang , Sang Chul Jung , Sungrae Park , Teakgyu Hong

Computer science texts are particularly rich in both narrative content and illustrative charts, algorithms, images, annotated diagrams, etc. This study explores the extent to which vector-based multimodal retrieval, powered by…

Information Retrieval · Computer Science 2025-09-11 Beth Plale , Sai Navya Jyesta , Sachith Withana

Document parsing aims to transform unstructured PDF images into semi-structured data, facilitating the digitization and utilization of information in diverse domains. While vision language models (VLMs) have significantly advanced this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Qintong Zhang , Junyuan Zhang , Zhifei Ren , Linke Ouyang , Zichen Wen , Junbo Niu , Yuan Qu , Bin Wang , Ka-Ho Chow , Conghui He , Wentao Zhang

Industrial diagrams such as piping and instrumentation diagrams (P&IDs) are essential for the design, operation, and maintenance of industrial plants. Converting these diagrams into digital form is an important step toward building digital…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sanjukta Ghosh

This work introduces VERSE, a methodology for analyzing and improving Vision-Language Models applied to Visually-rich Document Understanding by exploring their visual embedding space. VERSE enables the visualization of latent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Ignacio de Rodrigo , Alvaro J. Lopez-Lopez , Jaime Boal

Retrievability measures the influence a retrieval system has on the access to information in a given collection of items. This measure can help in making an evaluation of the search system based on which insights can be drawn. In this…

Information Retrieval · Computer Science 2023-05-26 Dwaipayan Roy , Zeljko Carevic , Philipp Mayr

Information extraction (IE) from documents is an intensive area of research with a large set of industrial applications. Current state-of-the-art methods focus on scanned documents with approaches combining computer vision, natural language…

Computation and Language · Computer Science 2022-08-16 Ismail Oussaid , William Vanhuffel , Pirashanth Ratnamogan , Mhamed Hajaiej , Alexis Mathey , Thomas Gilles

Document understanding tasks, in particular, Visually-rich Document Entity Retrieval (VDER), have gained significant attention in recent years thanks to their broad applications in enterprise AI. However, publicly available data have been…

Computation and Language · Computer Science 2023-10-27 Lijun Yu , Jin Miao , Xiaoyu Sun , Jiayi Chen , Alexander G. Hauptmann , Hanjun Dai , Wei Wei

Large language models (LLMs) are becoming useful in many domains due to their impressive abilities that arise from large training datasets and large model sizes. However, research on LLM-based approaches to document inconsistency detection…

Computation and Language · Computer Science 2026-04-09 Nelvin Tan , Yaowen Zhang , James Asikin Cheung , Fusheng Liu , Yu-Ching Shih , Dong Yang

In Software Engineering, some of the most critical activities are maintenance and evolution. However, to perform both with quality, minimizing impacts and risks, developers need to analyze and identify where the main problems come from…

Software Engineering · Computer Science 2020-08-11 Guilherme Lacerda , Fabio Petrillo , Marcelo Pimenta

Information extraction (IE) from Visually Rich Documents (VRDs) containing layout features along with text is a critical and well-studied task. Specialized non-LLM NLP-based solutions typically involve training models using both textual and…

Information Retrieval · Computer Science 2025-05-21 Aniket Bhattacharyya , Anurag Tripathi , Ujjal Das , Archan Karmakar , Amit Pathak , Maneesh Gupta

In this paper, we investigate the retrievability of datasets and publications in a real-life Digital Library (DL). The measure of retrievability was originally developed to quantify the influence that a retrieval system has on the access to…

Information Retrieval · Computer Science 2022-07-22 Dwaipayan Roy , Zeljko Carevic , Philipp Mayr

Visual document understanding (VDU) is a challenging task that involves understanding documents across various modalities (text and image) and layouts (forms, tables, etc.). This study aims to enhance generalizability of small VDU models by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Sungnyun Kim , Haofu Liao , Srikar Appalaraju , Peng Tang , Zhuowen Tu , Ravi Kumar Satzoda , R. Manmatha , Vijay Mahadevan , Stefano Soatto

Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yihao Ding , Kaixuan Ren , Jiabin Huang , Siwen Luo , Soyeon Caren Han

The axiomatic analysis of IR evaluation metrics has contributed to a better understanding of their properties. Some works have modelled the effectiveness of retrieval measures with axioms that capture desirable properties on the set of…

Information Retrieval · Computer Science 2022-07-11 Fernando Giner

This paper introduces a deep learning model tailored for document information analysis, emphasizing document classification, entity relation extraction, and document visual question answering. The proposed model leverages transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Tofik Ali , Partha Pratim Roy

This paper introduces the MERIT Dataset, a multimodal (text + image + layout) fully labeled dataset within the context of school reports. Comprising over 400 labels and 33k samples, the MERIT Dataset is a valuable resource for training…

Artificial Intelligence · Computer Science 2026-03-04 I. de Rodrigo , A. Sanchez-Cuadrado , J. Boal , A. J. Lopez-Lopez

Multimodal information extraction (MIE) is crucial for scientific literature, where valuable data is often spread across text, figures, and tables. In materials science, extracting structured information from research articles can…

Computation and Language · Computer Science 2024-10-29 Ghazal Khalighinejad , Sharon Scott , Ollie Liu , Kelly L. Anderson , Rickard Stureborg , Aman Tyagi , Bhuwan Dhingra