English
Related papers

Related papers: Document Understanding Dataset and Evaluation (DUD…

200 papers

Understanding visually-rich business documents to extract structured data and automate business workflows has been receiving attention both in academia and industry. Although recent multi-modal language models have achieved impressive…

Computation and Language · Computer Science 2023-09-19 Zilong Wang , Yichao Zhou , Wei Wei , Chen-Yu Lee , Sandeep Tata

The field of visually rich document understanding (VRDU) aims to solve a multitude of well-researched NLP tasks in a multi-modal domain. Several datasets exist for research on specific tasks of VRDU such as document classification (DC), key…

Understanding documents is central to many real-world tasks but remains a challenging topic. Unfortunately, there is no well-established consensus on how to comprehensively evaluate document understanding abilities, which significantly…

Computation and Language · Computer Science 2023-05-17 Ruoxi Xu , Hongyu Lin , Xinyan Guan , Xianpei Han , Yingfei Sun , Le Sun

Document AI, or Document Intelligence, is a relatively new research topic that refers to the techniques for automatically reading, understanding, and analyzing business documents. It is an important research direction for natural language…

Computation and Language · Computer Science 2021-11-17 Lei Cui , Yiheng Xu , Tengchao Lv , Furu Wei

Visually Rich Documents (VRDs) play a vital role in domains such as academia, finance, healthcare, and marketing, as they convey information through a combination of text, layout, and visual elements. Traditional approaches to extracting…

Computation and Language · Computer Science 2025-06-23 Yihao Ding , Soyeon Caren Han , Jean Lee , Eduard Hovy

Visually Rich Document Understanding (VRDU) has emerged as a critical field in document intelligence, enabling automated extraction of key information from complex documents across domains such as medical, financial, and educational…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yihao Ding , Soyeon Caren Han , Yan Li , Josiah Poon

Document-based Visual Question Answering examines the document understanding of document images in conditions of natural language questions. We proposed a new document-based VQA dataset, PDF-VQA, to comprehensively examine the document…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Yihao Ding , Siwen Luo , Hyunsuk Chung , Soyeon Caren Han

Key Information Extraction (KIE) is aimed at extracting structured information (e.g. key-value pairs) from form-style documents (e.g. invoices), which makes an important step towards intelligent document understanding. Previous approaches…

Artificial Intelligence · Computer Science 2022-06-15 Fengbin Zhu , Chao Wang , Wenqiang Lei , Ziyang Liu , Tat Seng Chua

Building document-grounded dialogue systems have received growing interest as documents convey a wealth of human knowledge and commonly exist in enterprises. Wherein, how to comprehend and retrieve information from documents is a…

Computation and Language · Computer Science 2022-07-15 Zhenyu Zhang , Bowen Yu , Haiyang Yu , Tingwen Liu , Cheng Fu , Jingyang Li , Chengguang Tang , Jian Sun , Yongbin Li

Visual document understanding (VDU) is a challenging task that involves understanding documents across various modalities (text and image) and layouts (forms, tables, etc.). This study aims to enhance generalizability of small VDU models by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Sungnyun Kim , Haofu Liao , Srikar Appalaraju , Peng Tang , Zhuowen Tu , Ravi Kumar Satzoda , R. Manmatha , Vijay Mahadevan , Stefano Soatto

We present a unified dataset for document Question-Answering (QA), which is obtained combining several public datasets related to Document AI and visually rich document understanding (VRDU). Our main contribution is twofold: on the one hand…

Computation and Language · Computer Science 2025-12-12 Simone Giovannini , Fabio Coppini , Andrea Gemelli , Simone Marinai

The use of visually-rich documents (VRDs) in various fields has created a demand for Document AI models that can read and comprehend documents like humans, which requires the overcoming of technical, linguistic, and cognitive barriers.…

Human-Computer Interaction · Computer Science 2023-10-24 Hao Wang , Qingxuan Wang , Yue Li , Changqing Wang , Chenhui Chu , Rui Wang

Document Structured Extraction (DSE) aims to extract structured content from raw documents. Despite the emergence of numerous DSE systems, their unified evaluation remains inadequate, significantly hindering the field's advancement. This…

Computation and Language · Computer Science 2025-07-15 Zichao Li , Aizier Abulaiti , Yaojie Lu , Xuanang Chen , Jia Zheng , Hongyu Lin , Xianpei Han , Le Sun

Decomposing images of document pages into high-level semantic regions (e.g., figures, tables, paragraphs), document object detection (DOD) is fundamental for downstream tasks like intelligent document editing and understanding. DOD remains…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Kai Li , Curtis Wigington , Chris Tensmeyer , Handong Zhao , Nikolaos Barmpalios , Vlad I. Morariu , Varun Manjunatha , Tong Sun , Yun Fu

Document image classification is different from plain-text document classification and consists of classifying a document by understanding the content and structure of documents such as forms, emails, and other such documents. We show that…

Computation and Language · Computer Science 2023-10-26 Yoshinari Fujinuma , Siddharth Varia , Nishant Sankaran , Srikar Appalaraju , Bonan Min , Yogarshi Vyas

Visually Rich Document Understanding (VRDU) has become a pivotal area of research, driven by the need to automatically interpret documents that contain intricate visual, textual, and structural elements. Recently, Multimodal Large Language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yihao Ding , Siwen Luo , Yue Dai , Yanbei Jiang , Zechuan Li , Qiang Sun , Geoffrey Martin , Wei Liu , Yifan Peng

Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yihao Ding , Kaixuan Ren , Jiabin Huang , Siwen Luo , Soyeon Caren Han

Recent approaches for visually-rich document understanding (VrDU) uses manually annotated semantic groups, where a semantic group encompasses all semantically relevant but not obviously grouped words. As OCR tools are unable to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Zhouqiang Jiang , Bowen Wang , Junhao Chen , Yuta Nakashima

Document understanding tasks, in particular, Visually-rich Document Entity Retrieval (VDER), have gained significant attention in recent years thanks to their broad applications in enterprise AI. However, publicly available data have been…

Computation and Language · Computer Science 2023-10-27 Lijun Yu , Jin Miao , Xiaoyu Sun , Jiayi Chen , Alexander G. Hauptmann , Hanjun Dai , Wei Wei

Document set expansion aims to identify relevant documents from a large collection based on a small set of documents that are on a fine-grained topic. Previous work shows that PU learning is a promising method for this task. However, some…

Machine Learning · Computer Science 2024-01-23 Haiyang Zhang , Qiuyi Chen , Yuanjie Zou , Yushan Pan , Jia Wang , Mark Stevenson
‹ Prev 1 2 3 10 Next ›