English
Related papers

Related papers: Document AI: A Comparative Study of Transformer-Ba…

200 papers

Ontologies comprising of concepts, their attributes, and relationships are used in many knowledge based AI systems. While there have been efforts towards populating domain specific ontologies, we examine the role of document structure in…

Artificial Intelligence · Computer Science 2022-04-14 Abhay M Shalghar , Ayush Kumar , Balaji Ganesan , Aswin Kannan , Akshay Parekh , Shobha G

Self-supervised pre-training techniques have achieved remarkable progress in Document AI. Most multimodal pre-trained models use a masked language modeling objective to learn bidirectional representations on the text modality, but they…

Computation and Language · Computer Science 2022-07-20 Yupan Huang , Tengchao Lv , Lei Cui , Yutong Lu , Furu Wei

This paper surveys the current state of the art in document automation (DA). The objective of DA is to reduce the manual effort during the generation of documents by automatically creating and integrating input from different sources and…

Computation and Language · Computer Science 2023-08-21 Mohammad Ahmadi Achachlouei , Omkar Patil , Tarun Joshi , Vijayan N. Nair

Document layout analysis (DLA) is the task of detecting the distinct, semantic content within a document and correctly classifying these items into an appropriate category (e.g., text, title, figure). DLA pipelines enable users to convert…

Machine Learning · Computer Science 2023-08-07 Jilin Wang , Michael Krumdick , Baojia Tong , Hamima Halim , Maxim Sokolov , Vadym Barda , Delphine Vendryes , Chris Tanner

Image Transformer has recently achieved significant progress for natural image understanding, either using supervised (ViT, DeiT, etc.) or self-supervised (BEiT, MAE, etc.) pre-training techniques. In this paper, we propose \textbf{DiT}, a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Junlong Li , Yiheng Xu , Tengchao Lv , Lei Cui , Cha Zhang , Furu Wei

The automatic analysis of document layouts in digital-born PDF documents remains a challenging problem due to the heterogeneous arrangement of textual and nontextual elements and the imprecision of the textual metadata in the Portable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Miguel Lopez-Duran , Julian Fierrez , Aythami Morales , Ruben Tolosana , Oscar Delgado-Mohatar , Alvaro Ortigosa

In this paper, we present a novel neural graph matching approach applied to document comparison. Document comparison is a common task in the legal and financial industries. In some cases, the most important differences may be the addition…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Po-Fang Hsu , Chiching Wei

Advances in Visually Rich Document Understanding (VrDU) have enabled information extraction and question answering over documents with complex layouts. Two tropes of architectures have emerged -- transformer-based models inspired by LLMs,…

Computation and Language · Computer Science 2024-01-08 Dongsheng Wang , Zhiqiang Ma , Armineh Nourbakhsh , Kang Gu , Sameena Shah

Understanding documents is central to many real-world tasks but remains a challenging topic. Unfortunately, there is no well-established consensus on how to comprehensively evaluate document understanding abilities, which significantly…

Computation and Language · Computer Science 2023-05-17 Ruoxi Xu , Hongyu Lin , Xinyan Guan , Xianpei Han , Yingfei Sun , Le Sun

Since their release, Transformers have revolutionized many fields from Natural Language Understanding to Computer Vision. Document Understanding (DU) was not left behind with first Transformer based models for DU dating from late 2019.…

Computation and Language · Computer Science 2023-09-12 Thibault Douzon , Stefan Duffner , Christophe Garcia , Jérémy Espinas

Although transformer-based models have shown strong performance in word- and sentence-level tasks, effectively representing long documents, especially in fields like law and medicine, remains difficult. Sparse attention mechanisms can…

Computation and Language · Computer Science 2026-01-01 Waheed Ahmed Abro , Zied Bouraoui

Document layout analysis has a wide range of requirements across various domains, languages, and business scenarios. However, most current state-of-the-art algorithms are language-dependent, with architectures that rely on transformer…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shu Wei , Nuo Xu

Document layout analysis usually relies on computer vision models to understand documents while ignoring textual information that is vital to capture. Meanwhile, high quality labeled datasets with both visual and textual information are…

Computation and Language · Computer Science 2020-11-12 Minghao Li , Yiheng Xu , Lei Cui , Shaohan Huang , Furu Wei , Zhoujun Li , Ming Zhou

One of the major prerequisites for any deep learning approach is the availability of large-scale training data. When dealing with scanned document images in real world scenarios, the principal information of its content is stored in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Sanket Biswas , Pau Riba , Josep Lladós , Umapada Pal

The problem of change detection in images finds application in different domains like diagnosis of diseases in the medical field, detecting growth patterns of cities through remote sensing, and finding changes in legal documents and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Abhinandan Kumar Pun , Mohammed Javed , David S. Doermann

Pre-training techniques have been verified successfully in a variety of NLP tasks in recent years. Despite the widespread use of pre-training models for NLP applications, they almost exclusively focus on text-level manipulation, while…

Computation and Language · Computer Science 2020-06-17 Yiheng Xu , Minghao Li , Lei Cui , Shaohan Huang , Furu Wei , Ming Zhou

Several methods have been proposed for classifying long textual documents using Transformers. However, there is a lack of consensus on a benchmark to enable a fair comparison among different approaches. In this paper, we provide a…

Computation and Language · Computer Science 2022-03-23 Hyunji Hayley Park , Yogarshi Vyas , Kashif Shah

Document layout analysis is a key area in document research, involving techniques like text mining and visual analysis. Despite various methods developed to tackle layout analysis, a critical but frequently overlooked problem is the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Talha Uddin Sheikh , Tahira Shehzadi , Khurram Azeem Hashmi , Didier Stricker , Muhammad Zeshan Afzal

The adoption of Deep Neural Networks (DNNs) has greatly benefited Natural Language Processing (NLP) during the past decade. However, the demands of long document analysis are quite different from those of shorter texts, while the ever…

Computation and Language · Computer Science 2024-03-18 Dimitrios Tsirmpas , Ioannis Gkionis , Georgios Th. Papadopoulos , Ioannis Mademlis

When reading a document, glancing at the spatial layout of a document is an initial step to understand it roughly. Traditional document layout analysis (DLA) methods, however, offer only a superficial parsing of documents, focusing on basic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yufan Chen , Ruiping Liu , Junwei Zheng , Di Wen , Kunyu Peng , Jiaming Zhang , Rainer Stiefelhagen