English
Related papers

Related papers: Document Intelligence Metrics for Visually Rich Do…

200 papers

Requirements identification in textual documents or extraction is a tedious and error prone task that many researchers suggest automating. We manually annotated the PURE dataset and thus created a new one containing both requirements and…

Software Engineering · Computer Science 2022-02-07 Vladimir Ivanov , Andrey Sadovykh , Alexandr Naumchev , Alessandra Bagnato , Kirill Yakovlev

Vision-Language Models (VLMs) excel in diverse visual tasks but face challenges in document understanding, which requires fine-grained text processing. While typical visual tasks perform well with low-resolution inputs, reading-intensive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Mor Shpigel Nacson , Aviad Aberdam , Roy Ganz , Elad Ben Avraham , Alona Golts , Yair Kittenplon , Shai Mazor , Ron Litman

Modeling and leveraging layout reading order in visually-rich documents (VrDs) is critical in document intelligence as it captures the rich structure semantics within documents. Previous works typically formulated layout reading order as a…

Computation and Language · Computer Science 2024-10-01 Chong Zhang , Yi Tu , Yixi Zhao , Chenshu Yuan , Huan Chen , Yue Zhang , Mingxu Chai , Ya Guo , Huijia Zhu , Qi Zhang , Tao Gui

Visual similarities discovery (VSD) is an important task with broad e-commerce applications. Given an image of a certain object, the goal of VSD is to retrieve images of different objects with high perceptual visual similarity. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Oren Barkan , Tal Reiss , Jonathan Weill , Ori Katz , Roy Hirsch , Itzik Malkiel , Noam Koenigstein

Large language models (LLMs) have demonstrated remarkable capabilities in text analysis tasks, yet their evaluation on complex, real-world applications remains challenging. We define a set of tasks, Multi-Insight Multi-Document Extraction…

Computation and Language · Computer Science 2024-12-02 John Francis , Saba Esnaashari , Anton Poletaev , Sukankana Chakraborty , Youmna Hashem , Jonathan Bright

Visual Document Retrieval (VDR) requires representations that capture both fine-grained visual details and global document structure to ensure retrieval efficacy while maintaining computational efficiency. Existing VDR models struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Fengbin Zhu , Zijing Cai , Yuzhe Wang , Pengyang Shao , Wenjie Wang , Fuli Feng , Richang Hong , Tat-Seng Chua

This paper gives a review and synthesis of methods of evaluating dimensionality reduction techniques. Particular attention is paid to rank-order neighborhood evaluation metrics. A framework is created for exploring dimensionality reduction…

Machine Learning · Computer Science 2019-02-25 Stephen L. France , Ulas Akkucuk

Object Recognition and Document Skew Estimation have come a long way in terms of performance and efficiency. New models follow one of two directions: improving performance using larger models, and improving efficiency using smaller models.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Lucas Wojcik , Luiz Coelho , Roger Granada , David Menotti

As large language models (LLMs) converge towards similar capabilities, the key to advancing their performance lies in identifying and incorporating valuable new information sources. However, evaluating which text collections are worth the…

Computation and Language · Computer Science 2026-01-09 Tristan Karch , Luca Engel , Philippe Schwaller , Frédéric Kaplan

The rapid advancement of multimodal large language models (MLLMs) has profoundly impacted the document domain, creating a wide array of application scenarios. This progress highlights the need for a comprehensive benchmark to evaluate these…

Computation and Language · Computer Science 2025-05-23 Siqi Li , Yufan Shen , Xiangnan Chen , Jiayi Chen , Hengwei Ju , Haodong Duan , Song Mao , Hongbin Zhou , Bo Zhang , Bin Fu , Pinlong Cai , Licheng Wen , Botian Shi , Yong Liu , Xinyu Cai , Yu Qiao

In this paper, we report the development of a model and a proof-of-concept visual text analytics (VTA) tool to enhance documentdiscovery in a problem-driven visualization research (PDVR) con-text. The proposed model captures the cognitive…

Human-Computer Interaction · Computer Science 2020-09-22 Alejandro Benito-Santos , Roberto Therón

Visual document understanding is a complex task that involves analyzing both the text and the visual elements in document images. Existing models often rely on manual feature engineering or domain-specific pipelines, which limit their…

This paper presents a groundbreaking multimodal, multi-task, multi-teacher joint-grained knowledge distillation model for visually-rich form document understanding. The model is designed to leverage insights from both fine-grained and…

Computation and Language · Computer Science 2024-07-29 Yihao Ding , Lorenzo Vaiani , Caren Han , Jean Lee , Paolo Garza , Josiah Poon , Luca Cagliero

Relevance is generally understood as a multi-level and multi-dimensional relationship between an information need and an information object. However, traditional IR evaluation metrics naively assume mono-dimensionality. We ask: How to deal…

Information Retrieval · Computer Science 2023-05-02 Kal Jarvelin , Eero Sormunen

Since real-world ubiquitous documents (e.g., invoices, tickets, resumes and leaflets) contain rich information, automatic document image understanding has become a hot topic. Most existing works decouple the problem into two separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Peng Zhang , Yunlu Xu , Zhanzhan Cheng , Shiliang Pu , Jing Lu , Liang Qiao , Yi Niu , Fei Wu

Humans naturally share information with those they are connected to, and video has become one of the dominant mediums for communication and expression on the Internet. To support the creation of high-quality large-scale video content, a…

Extracting information from academic PDF documents is crucial for numerous indexing, retrieval, and analysis use cases. Choosing the best tool to extract specific content elements is difficult because many, technically diverse tools are…

Information Retrieval · Computer Science 2023-03-20 Norman Meuschke , Apurva Jagdale , Timo Spinde , Jelena Mitrović , Bela Gipp

Vision-language (VL) models have shown transformative potential across various critical domains due to their capability to comprehend multi-modal information. However, their performance frequently degrades under distribution shifts, making…

Human-Computer Interaction · Computer Science 2025-09-19 Huanchen Wang , Wencheng Zhang , Zhiqiang Wang , Zhicong Lu , Yuxin Ma

Document coherence describes how much sense text makes in terms of its logical organisation and discourse flow. Even though coherence is a relatively difficult notion to quantify precisely, it can be approximated automatically. This type of…

Information Retrieval · Computer Science 2016-08-03 Christina Lioma , Fabien Tarissan , Jakob Grue Simonsen , Casper Petersen , Birger Larsen

Information Extraction from visually rich documents is a challenging task that has gained a lot of attention in recent years due to its importance in several document-control based applications and its widespread commercial value. The…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Mohamed Dhouib , Ghassen Bettaieb , Aymen Shabou