English
Related papers

Related papers: Document Understanding Dataset and Evaluation (DUD…

200 papers

Foundation models, such as large language models (LLMs), have the potential to streamline evaluation workflows and improve their performance. However, practical adoption faces challenges, such as customisability, accuracy, and scalability.…

Information Retrieval · Computer Science 2025-11-11 Hao Zhang , Qinghua Lu , Liming Zhu

This paper highlights the need to bring document classification benchmarking closer to real-world applications, both in the nature of data tested ($X$: multi-channel, multi-paged, multi-industry; $Y$: class distributions and label set…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Jordy Van Landeghem , Sanket Biswas , Matthew B. Blaschko , Marie-Francine Moens

Despite the rapid progress of Vision-Language Models (VLMs), their capabilities are inadequately assessed by existing benchmarks, which are predominantly English-centric, feature simplistic layouts, and support limited tasks. Consequently,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Ketong Chen , Yuhao Chen , Yang Xue

Document-level Relation Extraction (DocRE) aims to identify relationships between entity pairs within a document. However, most existing methods assume a uniform label distribution, resulting in suboptimal performance on real-world,…

Computation and Language · Computer Science 2025-01-14 Khai Phan Tran , Wen Hua , Xue Li

We study the problem of completing various visual document understanding (VDU) tasks, e.g., question answering and information extraction, on real-world documents through human-written instructions. To this end, we propose InstructDoc, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Ryota Tanaka , Taichi Iki , Kyosuke Nishida , Kuniko Saito , Jun Suzuki

Starting with early successes in computer vision tasks, deep learning based techniques have since overtaken state of the art approaches in a multitude of domains. However, it has been demonstrated time and again that these techniques fail…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Soumadeep Saha , Saptarshi Saha , Utpal Garain

Audio-visual understanding is a rapidly evolving field that seeks to integrate and interpret information from both auditory and visual modalities. Despite recent advances in multi-modal learning, existing benchmarks often suffer from strong…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Gorjan Radevski , Teodora Popordanoska , Matthew B. Blaschko , Tinne Tuytelaars

Visual document understanding is a complex task that involves analyzing both the text and the visual elements in document images. Existing models often rely on manual feature engineering or domain-specific pipelines, which limit their…

Document Layout analysis (DLA), is the process by which a page is parsed into meaningful elements, often using machine learning models. Typically, the quality of a model is judged using general object detection metrics such as IoU, F1 or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jonathan Bourne , Mwiza Simbeye , Ishtar Govia

Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG).…

Relational understanding is critical for a number of visually-rich documents (VRDs) understanding tasks. Through multi-modal pre-training, recent studies provide comprehensive contextual representations and exploit them as prior knowledge…

Computation and Language · Computer Science 2022-05-06 Xin Li , Yan Zheng , Yiqing Hu , Haoyu Cao , Yunfei Wu , Deqiang Jiang , Yinsong Liu , Bo Ren

Document understanding and information extraction include different tasks to understand a document and extract valuable information automatically. Recently, there has been a rising demand for developing document understanding among…

Information Retrieval · Computer Science 2023-08-01 Soyeon Caren Han , Yihao Ding , Siwen Luo , Josiah Poon , HeeGuen Yoon , Zhe Huang , Paul Duuring , Eun Jung Holden

Document layout analysis is a known problem to the documents research community and has been vastly explored yielding a multitude of solutions ranging from text mining, and recognition to graph-based representation, visual feature…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Subhajit Maity , Sanket Biswas , Siladittya Manna , Ayan Banerjee , Josep Lladós , Saumik Bhattacharya , Umapada Pal

Document understanding in real-world applications often requires processing heterogeneous, multi-page document packets containing multiple documents stitched together. Despite recent advances in visual document understanding, the…

The Document Set Expansion (DSE) task involves identifying relevant documents from large collections based on a limited set of example documents. Previous research has highlighted Positive and Unlabeled (PU) learning as a promising approach…

Information Retrieval · Computer Science 2024-03-27 Haiyang Zhang , Qiuyi Chen , Yuanjie Zou , Yushan Pan , Jia Wang , Mark Stevenson

Document Understanding is an evolving field in Natural Language Processing (NLP). In particular, visual and spatial features are essential in addition to the raw text itself and hence, several multimodal models were developed in the field…

Computation and Language · Computer Science 2024-04-18 Wiam Adnan , Joel Tang , Yassine Bel Khayat Zouggari , Seif Edinne Laatiri , Laurent Lam , Fabien Caspani

Document Visual Question Answering (VQA) aims to understand visually-rich documents to answer questions in natural language, which is an emerging research topic for both Natural Language Processing and Computer Vision. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Fengbin Zhu , Wenqiang Lei , Fuli Feng , Chao Wang , Haozhou Zhang , Tat-Seng Chua

We present a new dataset for Visual Question Answering (VQA) on document images called DocVQA. The dataset consists of 50,000 questions defined on 12,000+ document images. Detailed analysis of the dataset in comparison with similar datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Minesh Mathew , Dimosthenis Karatzas , C. V. Jawahar

This paper introduces SynthDoc, a novel synthetic document generation pipeline designed to enhance Visual Document Understanding (VDU) by generating high-quality, diverse datasets that include text, images, tables, and charts. Addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Chuanghao Ding , Xuejing Liu , Wei Tang , Juan Li , Xiaoliang Wang , Rui Zhao , Cam-Tu Nguyen , Fei Tan

With the rapid advancement of digitalization, various document images are being applied more extensively in production and daily life, and there is an increasingly urgent need for fast and accurate parsing of the content in document images.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Feng Ni , Kui Huang , Yao Lu , Wenyu Lv , Guanzhong Wang , Zeyu Chen , Yi Liu