English
Related papers

Related papers: DLAFormer: An End-to-End Transformer For Document …

200 papers

Text alignment finds application in tasks such as citation recommendation and plagiarism detection. Existing alignment methods operate at a single, predefined level and cannot learn to align texts at, for example, sentence and document…

Computation and Language · Computer Science 2020-10-06 Xuhui Zhou , Nikolaos Pappas , Noah A. Smith

Translating renderings (e. g. PDFs, scans) into hierarchical document structures is extensively demanded in the daily routines of many real-world applications. However, a holistic, principled approach to inferring the complete hierarchical…

Machine Learning · Computer Science 2021-01-26 Johannes Rausch , Octavio Martinez , Fabian Bissig , Ce Zhang , Stefan Feuerriegel

Scene text detection and document layout analysis have long been treated as two separate tasks in different image domains. In this paper, we bring them together and introduce the task of unified scene text detection and layout analysis. The…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Shangbang Long , Siyang Qin , Dmitry Panteleev , Alessandro Bissacco , Yasuhisa Fujii , Michalis Raptis

Document layout analysis (DLA) plays an important role in information extraction and document understanding. At present, document layout analysis has reached a milestone achievement, however, document layout analysis of non-Manhattan is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Tianlong Ma , Xingjiao Wu , Xin Li , Xiangcheng Du , Zhao Zhou , Liang Xue , Cheng Jin

Document Layout Analysis is a fundamental step in Handwritten Text Processing systems, from the extraction of the text lines to the type of zone it belongs to. We present a system based on artificial neural networks which is able to…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Lorenzo Quirós

This paper proposes LayoutLLM, a more flexible document analysis method for understanding imaged documents. Visually Rich Document Understanding tasks, such as document image classification and information extraction, have gained…

Computation and Language · Computer Science 2024-03-22 Masato Fujitake

Tabular data are crucial in many fields and their understanding by large language models (LLMs) under high parameter efficiency paradigm is important. However, directly applying parameter-efficient fine-tuning (PEFT) techniques to tabular…

Computation and Language · Computer Science 2025-06-30 Xinyi He , Yihao Liu , Mengyu Zhou , Yeye He , Haoyu Dong , Shi Han , Zejian Yuan , Dongmei Zhang

Pre-training techniques have been verified successfully in a variety of NLP tasks in recent years. Despite the widespread use of pre-training models for NLP applications, they almost exclusively focus on text-level manipulation, while…

Computation and Language · Computer Science 2020-06-17 Yiheng Xu , Minghao Li , Lei Cui , Shaohan Huang , Furu Wei , Ming Zhou

Recent advances in document image analysis (DIA) have been primarily driven by the application of neural networks. Ideally, research outcomes could be easily deployed in production and extended for further investigation. However, various…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zejiang Shen , Ruochen Zhang , Melissa Dell , Benjamin Charles Germain Lee , Jacob Carlson , Weining Li

Several methods have been proposed for classifying long textual documents using Transformers. However, there is a lack of consensus on a benchmark to enable a fair comparison among different approaches. In this paper, we provide a…

Computation and Language · Computer Science 2022-03-23 Hyunji Hayley Park , Yogarshi Vyas , Kashif Shah

Document reconstruction constitutes a significant facet of document analysis and recognition, a field that has been progressively accruing interest within the scholarly community. A multitude of these researchers employ an array of document…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Xin Li , Mingming Gong , Yunfei Wu , Jianxin Dai , Antai Guo , Xinghua Jiang , Haoyu Cao , Yinsong Liu , Deqiang Jiang , Xing Sun

Document images often have intricate layout structures, with numerous content regions (e.g. texts, figures, tables) densely arranged on each page. This makes the manual annotation of layout datasets expensive and inefficient. These…

Machine Learning · Computer Science 2021-03-31 Zejiang Shen , Jian Zhao , Melissa Dell , Yaoliang Yu , Weining Li

Pre-training of text and layout has proved effective in a variety of visually-rich document understanding tasks due to its effective model architecture and the advantage of large-scale unlabeled scanned/digital-born documents. We propose…

Computation and Language · Computer Science 2022-01-11 Yang Xu , Yiheng Xu , Tengchao Lv , Lei Cui , Furu Wei , Guoxin Wang , Yijuan Lu , Dinei Florencio , Cha Zhang , Wanxiang Che , Min Zhang , Lidong Zhou

We propose DocFormerv2, a multi-modal transformer for Visual Document Understanding (VDU). The VDU domain entails understanding documents (beyond mere OCR predictions) e.g., extracting information from a form, VQA for documents and other…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Srikar Appalaraju , Peng Tang , Qi Dong , Nishant Sankaran , Yichu Zhou , R. Manmatha

Document layout comprises both structural and visual (eg. font-sizes) information that is vital but often ignored by machine learning models. The few existing models which do use layout information only consider textual contents, and…

Computation and Language · Computer Science 2021-04-20 Te-Lin Wu , Cheng Li , Mingyang Zhang , Tao Chen , Spurthi Amba Hombaiah , Michael Bendersky

Table detection, a pivotal task in document analysis, aims to precisely recognize and locate tables within document images. Although deep learning has shown remarkable progress in this realm, it typically requires an extensive dataset of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Iqraa Ehsan , Tahira Shehzadi , Didier Stricker , Muhammad Zeshan Afzal

Form understanding is a challenging problem which aims to recognize semantic entities from the input document and their hierarchical relations. Previous approaches face significant difficulty dealing with the complexity of the task, thus…

Artificial Intelligence · Computer Science 2021-06-03 Tuan-Anh Nguyen Dang , Duc-Thanh Hoang , Quang-Bach Tran , Chih-Wei Pan , Thanh-Dat Nguyen

We propose a novel multimodal architecture for Scene Text Visual Question Answering (STVQA), named Layout-Aware Transformer (LaTr). The task of STVQA requires models to reason over different modalities. Thus, we first investigate the impact…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Ali Furkan Biten , Ron Litman , Yusheng Xie , Srikar Appalaraju , R. Manmatha

Document layout understanding is a field of study that analyzes the spatial arrangement of information in a document hoping to understand its structure and layout. Models such as LayoutLM (and its subsequent iterations) can understand…

Computation and Language · Computer Science 2025-01-13 Pablo Melendez , Clemens Havas

Table detection is the task of classifying and localizing table objects within document images. With the recent development in deep learning methods, we observe remarkable success in table detection. However, a significant amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Tahira Shehzadi , Khurram Azeem Hashmi , Didier Stricker , Marcus Liwicki , Muhammad Zeshan Afzal