English
Related papers

Related papers: DocBank: A Benchmark Dataset for Document Layout A…

200 papers

Evaluating whether Multimodal Large Language Models can produce trustworthy, verifiable reasoning over long, visually rich documents requires evaluation beyond end-to-end answer accuracy. We introduce DocScope, a benchmark that formulates…

Computation and Language · Computer Science 2026-05-15 Xiang Feng , Jiawei Zhou , Zhangfeng Huang , Kewei Wang , Shanshan Ye , Jinxin Hu , Zulong Chen , Yong Luo , Jing Zhang

Before developing a Document Layout Analysis (DLA) model in real-world applications, conducting comprehensive robustness testing is essential. However, the robustness of DLA models remains underexplored in the literature. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yufan Chen , Jiaming Zhang , Kunyu Peng , Junwei Zheng , Ruiping Liu , Philip Torr , Rainer Stiefelhagen

Despite the rapid progress of Vision-Language Models (VLMs), their capabilities are inadequately assessed by existing benchmarks, which are predominantly English-centric, feature simplistic layouts, and support limited tasks. Consequently,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Ketong Chen , Yuhao Chen , Yang Xue

Identity document (ID) image analysis has become essential for many online services, like bank account opening or insurance subscription. In recent years, much research has been conducted on subjects like document localization, text…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Julien Lerouge , Guillaume Betmont , Thomas Bres , Evgeny Stepankevich , Alexis Bergès

Traditional banks face increasing competition from FinTechs in the rapidly evolving financial ecosystem. Raising operational efficiency is vital to address this challenge. Our study aims to improve the efficiency of document-intensive…

Computation and Language · Computer Science 2023-11-28 Christopher Gerling , Stefan Lessmann

Despite significant progress in multimodal large language models (MLLMs), their performance on complex, multi-page document comprehension remains inadequate, largely due to the lack of high-quality, document-level datasets. While current…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yuchen Duan , Zhe Chen , Yusong Hu , Weiyun Wang , Shenglong Ye , Botian Shi , Lewei Lu , Qibin Hou , Tong Lu , Hongsheng Li , Jifeng Dai , Wenhai Wang

In this paper, we introduce a fully convolutional network for the document layout analysis task. While state-of-the-art methods are using models pre-trained on natural scene images, our method Doc-UFCN relies on a U-shaped model trained…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Mélodie Boillet , Christopher Kermorvant , Thierry Paquet

Automating the annotation of scanned documents is challenging, requiring a balance between computational efficiency and accuracy. DocParseNet addresses this by combining deep learning and multi-modal learning to process both text and visual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ahmad Mohammadshirazi , Ali Nosrati Firoozsalari , Mengxi Zhou , Dheeraj Kulshrestha , Rajiv Ramnath

Analyzing the layout of a document to identify headers, sections, tables, figures etc. is critical to understanding its content. Deep learning based approaches for detecting the layout structure of document images have been promising.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Natraj Raman , Sameena Shah , Manuela Veloso

Document layout analysis (DLA) is the task of detecting the distinct, semantic content within a document and correctly classifying these items into an appropriate category (e.g., text, title, figure). DLA pipelines enable users to convert…

Machine Learning · Computer Science 2023-08-07 Jilin Wang , Michael Krumdick , Baojia Tong , Hamima Halim , Maxim Sokolov , Vadym Barda , Delphine Vendryes , Chris Tanner

Understanding documents with rich layouts and multi-modal components is a long-standing and practical task. Recent Large Vision-Language Models (LVLMs) have made remarkable strides in various tasks, particularly in single-page document…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yubo Ma , Yuhang Zang , Liangyu Chen , Meiqi Chen , Yizhu Jiao , Xinze Li , Xinyuan Lu , Ziyu Liu , Yan Ma , Xiaoyi Dong , Pan Zhang , Liangming Pan , Yu-Gang Jiang , Jiaqi Wang , Yixin Cao , Aixin Sun

We focus on electronic theses and dissertations (ETDs), aiming to improve access and expand their utility, since more than 6 million are publicly available, and they constitute an important corpus to aid research and education across…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Sampanna Yashwant Kahu , William A. Ingram , Edward A. Fox , Jian Wu

Document image classification is different from plain-text document classification and consists of classifying a document by understanding the content and structure of documents such as forms, emails, and other such documents. We show that…

Computation and Language · Computer Science 2023-10-26 Yoshinari Fujinuma , Siddharth Varia , Nishant Sankaran , Srikar Appalaraju , Bonan Min , Yogarshi Vyas

Document AI, or Document Intelligence, is a relatively new research topic that refers to the techniques for automatically reading, understanding, and analyzing business documents. It is an important research direction for natural language…

Computation and Language · Computer Science 2021-11-17 Lei Cui , Yiheng Xu , Tengchao Lv , Furu Wei

Recent advances in document image analysis (DIA) have been primarily driven by the application of neural networks. Ideally, research outcomes could be easily deployed in production and extended for further investigation. However, various…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zejiang Shen , Ruochen Zhang , Melissa Dell , Benjamin Charles Germain Lee , Jacob Carlson , Weining Li

Multimodal Large Language Models (MLLM) have made significant progress in the field of document analysis. Despite this, existing benchmarks typically focus only on extracting text and simple layout information, neglecting the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Lei Chen , Feng Yan , Yujie Zhong , Shaoxiang Chen , Zequn Jie , Lin Ma

Document Layout Parsing serves as a critical gateway for Artificial Intelligence (AI) to access and interpret the world's vast stores of structured knowledge. This process,which encompasses layout detection, text recognition, and relational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yumeng Li , Guang Yang , Hao Liu , Bowen Wang , Colin Zhang

Deep Research systems have revolutionized how LLMs solve complex questions through iterative reasoning and evidence gathering. However, current systems remain fundamentally constrained to textual web data, overlooking the vast knowledge…

Information Retrieval · Computer Science 2025-10-27 Kuicai Dong , Shurui Huang , Fangda Ye , Wei Han , Zhi Zhang , Dexun Li , Wenjun Li , Qu Yang , Gang Wang , Yichao Wang , Chen Zhang , Yong Liu

Document-based Visual Question Answering examines the document understanding of document images in conditions of natural language questions. We proposed a new document-based VQA dataset, PDF-VQA, to comprehensively examine the document…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Yihao Ding , Siwen Luo , Hyunsuk Chung , Soyeon Caren Han

Document understanding tasks, in particular, Visually-rich Document Entity Retrieval (VDER), have gained significant attention in recent years thanks to their broad applications in enterprise AI. However, publicly available data have been…

Computation and Language · Computer Science 2023-10-27 Lijun Yu , Jin Miao , Xiaoyu Sun , Jiayi Chen , Alexander G. Hauptmann , Hanjun Dai , Wei Wei