English
Related papers

Related papers: Document Parsing Unveiled: Techniques, Challenges,…

200 papers

Retrieval Augmented Generation (RAG) systems struggle with processing multimodal documents of varying structural complexity. This paper introduces a novel multi-strategy parsing approach using LLM-powered OCR to extract content from diverse…

Computation and Language · Computer Science 2024-12-23 Arnau Perez , Xavier Vizcaino

Large Language Models (LLM) have revolutionized Natural Language Processing (NLP), improving state-of-the-art and exhibiting emergent capabilities across various tasks. However, their application in extracting information from visually rich…

Computation and Language · Computer Science 2024-06-25 Vincent Perot , Kai Kang , Florian Luisier , Guolong Su , Xiaoyu Sun , Ramya Sree Boppana , Zilong Wang , Zifeng Wang , Jiaqi Mu , Hao Zhang , Chen-Yu Lee , Nan Hua

Extracting structured information from academic PDF documents is non trivial: a single page typically combines free text metadata with tabular regions, exhibits cross program variation, and is susceptible to Unicode encoding artifacts that…

Computation and Language · Computer Science 2026-05-25 Muhammad Anis Al Hilmi , Neelansh Khare , Noel Framil Iglesias , Kurnia Adi Cahyanto , Azhar Al Afghani , Musfi Yuliadi

The adoption of Deep Neural Networks (DNNs) has greatly benefited Natural Language Processing (NLP) during the past decade. However, the demands of long document analysis are quite different from those of shorter texts, while the ever…

Computation and Language · Computer Science 2024-03-18 Dimitrios Tsirmpas , Ioannis Gkionis , Georgios Th. Papadopoulos , Ioannis Mademlis

Understanding long-context visual information remains a fundamental challenge for vision-language models, particularly in agentic tasks such as GUI control and web navigation. While web pages and GUI environments are inherently structured…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Gyubeum Lim , Yemo Koo , Vijay Krishna Madisetti

Accurate document parsing requires both robust content recognition and a stable parser interface. In explicit Document Layout Analysis (DLA) pipelines, downstream parsers do not consume the full detector output. Instead, they operate on a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Fuyuan Liu , Dianyu Yu , He Ren , Nayu Liu , Xiaomian Kang , Delai Qiu , Fa Zhang , Genpeng Zhen , Shengping Liu , Jiaen Liang , Wei Huang , Yining Wang , Junnan Zhu

The representation of workflows and processes is essential in materials science engineering, where experimental and computational reproducibility depend on structured and semantically coherent process models. Although numerous ontologies…

Information Retrieval · Computer Science 2025-09-30 Ebrahim Norouzi , Sven Hertling , Jörg Waitelonis , Harald Sack

Retrieving accurate details from documents is a crucial task, especially when handling a combination of scanned images and native digital formats. This document presents a combined framework for text extraction that merges Optical Character…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Rasha Sinha , Rekha B S

Retrieval-Augmented Language Models (RALMs) face significant challenges in reducing factual errors, particularly in document relevance evaluation and knowledge integration. We introduce a framework for structured relevance assessment that…

Artificial Intelligence · Computer Science 2025-07-30 Aryan Raj , Astitva Veer Garg , Anitha D

Information Retrieval (IR) methods aim to identify documents relevant to a query, which have been widely applied in various natural language tasks. However, existing approaches typically consider only the textual content within documents,…

Computation and Language · Computer Science 2026-01-26 Jaewoo Lee , Joonho Ko , Jinheon Baek , Soyeong Jeong , Sung Ju Hwang

Document understanding in real-world applications often requires processing heterogeneous, multi-page document packets containing multiple documents stitched together. Despite recent advances in visual document understanding, the…

Visual Information Extraction (VIE) plays a crucial role in the comprehension of semi-structured documents, and several pre-trained models have been developed to enhance performance. However, most of these works are monolingual (usually…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Huawen Shen , Gengluo Li , Jinwen Zhong , Yu Zhou

Document Layout Analysis (DLA) pipelines provide structured page representations for retrieval-augmented generation, long-document question answering, and other document intelligence systems, yet their robustness evaluation remains largely…

Computation and Language · Computer Science 2026-05-27 Yue Chen , Yihao Wang , Ziyi Tang , Yongsen Zheng , Keze Wang

Existing long-document question answering systems typically process texts as flat sequences or use heuristic chunking, which overlook the discourse structures that naturally guide human comprehension. We present a discourse-aware…

Information Retrieval · Computer Science 2026-05-08 Huiyao Chen , Yi Yang , Yinghui Li , Meishan Zhang , Baotian Hu , Min Zhang

Explorative flow visualization allows domain experts to analyze complex flow structures by interactively investigating flow patterns. However, traditional visual interfaces often rely on specialized graphical representations and…

Human-Computer Interaction · Computer Science 2025-08-11 Weihan Zhang , Jun Tao

Understanding visually situated language requires interpreting complex layouts of textual and visual elements. Pre-processing tools, such as optical character recognition (OCR), can map document image inputs to textual tokens, then large…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Wang Zhu , Alekh Agarwal , Mandar Joshi , Robin Jia , Jesse Thomason , Kristina Toutanova

Large Language Models (LLMs) have revolutionized natural language processing with their remarkable capabilities in text generation and reasoning. However, these models face critical challenges when deployed in real-world applications,…

Computation and Language · Computer Science 2025-09-16 Pengcheng Jiang , Siru Ouyang , Yizhu Jiao , Ming Zhong , Runchu Tian , Jiawei Han

Text-rich document understanding (TDU) requires comprehensive analysis of documents containing substantial textual content and complex layouts. While Multimodal Large Language Models (MLLMs) have achieved fast progress in this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Wenhui Liao , Jiapeng Wang , Hongliang Li , Chengyu Wang , Jun Huang , Lianwen Jin

Visually rich documents (VRDs) are ubiquitous in daily business and life. Examples are purchase receipts, insurance policy documents, custom declaration forms and so on. In VRDs, visual and layout information is critical for document…

Information Retrieval · Computer Science 2019-03-28 Xiaojing Liu , Feiyu Gao , Qiong Zhang , Huasha Zhao

Recent efforts of multimodal Transformers have improved Visually Rich Document Understanding (VrDU) tasks via incorporating visual and textual information. However, existing approaches mainly focus on fine-grained elements such as words and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Wenjin Wang , Zhengjie Huang , Bin Luo , Qianglong Chen , Qiming Peng , Yinxu Pan , Weichong Yin , Shikun Feng , Yu Sun , Dianhai Yu , Yin Zhang