English
Related papers

Related papers: MathDoc: Benchmarking Structured Extraction and Ac…

200 papers

With the emergence of large language models (LLMs), there is an expectation that LLMs can effectively extract explicit information from complex real-world documents (e.g., papers, reports). However, most LLMs generate paragraph-style…

Computation and Language · Computer Science 2025-10-31 Tianyun Zhong , Guozhao Mo , Yanjiang Liu , Yihan Chen , Lingdi Kong , Xuanang Chen , Yaojie Lu , Hongyu Lin , Shiwei Ye , Xianpei Han , Ben He , Le Sun

Table of contents (ToC) extraction aims to extract headings of different levels in documents to better understand the outline of the contents, which can be widely used for document understanding and information retrieval. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Pengfei Hu , Zhenrong Zhang , Jianshu Zhang , Jun Du , Jiajia Wu

Developing document understanding models at enterprise scale requires large, diverse, and well-annotated datasets spanning a wide range of document types. However, collecting such data is prohibitively expensive due to privacy constraints,…

Understanding visually-rich business documents to extract structured data and automate business workflows has been receiving attention both in academia and industry. Although recent multi-modal language models have achieved impressive…

Computation and Language · Computer Science 2023-09-19 Zilong Wang , Yichao Zhou , Wei Wei , Chen-Yu Lee , Sandeep Tata

We study the problem of completing various visual document understanding (VDU) tasks, e.g., question answering and information extraction, on real-world documents through human-written instructions. To this end, we propose InstructDoc, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Ryota Tanaka , Taichi Iki , Kyosuke Nishida , Kuniko Saito , Jun Suzuki

Extracting structured information from text, such as key-value pairs that could augment tabular data, is quite useful in many enterprise use cases. Although large language models (LLMs) have enabled numerous automated pipelines for…

Computation and Language · Computer Science 2025-07-30 Satyananda Kashyap , Sola Shirai , Nandana Mihindukulasooriya , Horst Samulowitz

Automatic extraction of procedural graphs from documents creates a low-cost way for users to easily understand a complex procedure by skimming visual graphs. Despite the progress in recent studies, it remains unanswered: whether the…

Computation and Language · Computer Science 2024-08-09 Weihong Du , Wenrui Liao , Hongru Liang , Wenqiang Lei

With the rapid development of large language models (LLMs), the quality of training data has become crucial. Among the various types of training data, mathematical data plays a key role in enabling LLMs to acquire strong reasoning…

Computation and Language · Computer Science 2025-02-27 Hao Liang , Meiyi Qiang , Yuying Li , Zefeng He , Yongzhen Guo , Zhengzhou Zhu , Wentao Zhang , Bin Cui

Requirements identification in textual documents or extraction is a tedious and error prone task that many researchers suggest automating. We manually annotated the PURE dataset and thus created a new one containing both requirements and…

Software Engineering · Computer Science 2022-02-07 Vladimir Ivanov , Andrey Sadovykh , Alexandr Naumchev , Alessandra Bagnato , Kirill Yakovlev

While Large Language Models (LLMs) demonstrate impressive performance in mathematics, existing math benchmarks come with significant limitations. Many focus on problems with fixed ground-truth answers, and are often saturated due to problem…

Artificial Intelligence · Computer Science 2025-10-02 Mislav Balunović , Jasper Dekoninck , Nikola Jovanović , Ivo Petrov , Martin Vechev

Accurate extraction of key information from 2D engineering drawings is crucial for high-precision manufacturing. Manual extraction is slow and labor-intensive, while traditional Optical Character Recognition (OCR) techniques often struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Muhammad Tayyab Khan , Zane Yong , Lequn Chen , Jun Ming Tan , Wenhe Feng , Seung Ki Moon

Large Language Models are increasingly being deployed to extract structured data from unstructured and semi-structured sources: parsing invoices, medical records, and converting PDF documents to database entries. Yet existing benchmarks for…

Computation and Language · Computer Science 2026-04-29 Abhinav Kumar Singh , Harsha Vardhan Khurdula , Yoeven D Khemlani , Vineet Agarwal

Predicates are foundational components in data analysis systems. However, modern workloads increasingly involve unstructured documents, which demands semantic understanding, beyond traditional value-based predicates. Given enormous…

Databases · Computer Science 2026-05-22 Hengrui Zhang , Yulong Hui , Yihao Liu , Huanchen Zhang

Large vision language models (LVLMs) have improved the document understanding capabilities remarkably, enabling the handling of complex document elements, longer contexts, and a wider range of tasks. However, existing document understanding…

Artificial Intelligence · Computer Science 2025-07-16 Chao Deng , Jiale Yuan , Pi Bu , Peijie Wang , Zhong-Zhi Li , Jian Xu , Xiao-Hui Li , Yuan Gao , Jun Song , Bo Zheng , Cheng-Lin Liu

Document-level relation extraction (DocRE) attracts more research interest recently. While models achieve consistent performance gains in DocRE, their underlying decision rules are still understudied: Do they make the right predictions…

Computation and Language · Computer Science 2023-06-21 Haotian Chen , Bingsheng Chen , Xiangdong Zhou

Multi-modal large language models (LLMs) have shown remarkable performance in various natural language processing tasks, including data extraction from documents. However, the accuracy of these models can be significantly affected by…

Computation and Language · Computer Science 2024-06-18 Anjanava Biswas , Wrick Talukdar

Document parsing aims to transform unstructured PDF images into semi-structured data, facilitating the digitization and utilization of information in diverse domains. While vision language models (VLMs) have significantly advanced this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Qintong Zhang , Junyuan Zhang , Zhifei Ren , Linke Ouyang , Zichen Wen , Junbo Niu , Yuan Qu , Bin Wang , Ka-Ho Chow , Conghui He , Wentao Zhang

We present LLMStructBench, a novel benchmark for evaluating Large Language Models (LLMs) on extracting structured data and generating valid JavaScript Object Notation (JSON) outputs from natural-language text. Our open dataset comprises…

Computation and Language · Computer Science 2026-02-17 Sönke Tenckhoff , Mario Koddenbrock , Erik Rodner

Systematic reviews and meta-analyses rely on converting narrative articles into structured, numerically grounded study records. Despite rapid advances in large language models (LLMs), it remains unclear whether they can meet the structural…

Computation and Language · Computer Science 2026-02-12 Zhiyin Tan , Jennifer D'Souza

Table Extraction (TE) consists in extracting tables from PDF documents, in a structured format which can be automatically processed. While numerous TE tools exist, the variety of methods and techniques makes it difficult for users to choose…

Databases · Computer Science 2025-11-21 Marijan Soric , Cécile Gracianne , Ioana Manolescu , Pierre Senellart