English
Related papers

Related papers: Hybrid OCR-LLM Framework for Enterprise-Scale Docu…

200 papers

The proliferation of complex structured data in hybrid sources, such as PDF documents and web pages, presents unique challenges for current Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) in providing accurate…

Information Retrieval · Computer Science 2025-08-22 Shivani Upadhyay , Messiah Ataey , Syed Shariyar Murtaza , Yifan Nie , Jimmy Lin

Automated testing plays a crucial role in ensuring software security. It heavily relies on formal specifications to validate the correctness of the system behavior. However, the main approach to defining these formal specifications is…

Software Engineering · Computer Science 2025-04-03 Hui Li , Zhen Dong , Siao Wang , Hui Zhang , Liwei Shen , Xin Peng , Dongdong She

Reproducibility of computational results remains a challenge in materials science, as simulation workflows and parameters are often reported only in unstructured text and tables. While literature data are valuable for validation and reuse,…

Document parsing is a core task in document intelligence, supporting applications such as information extraction, retrieval-augmented generation, and automated document analysis. However, real-world documents often feature complex layouts…

A long standing goal of the data management community is to develop general, automated systems that ingest semi-structured documents and output queryable tables without human effort or domain specific customization. Given the sheer variety…

Computation and Language · Computer Science 2025-03-10 Simran Arora , Brandon Yang , Sabri Eyuboglu , Avanika Narayan , Andrew Hojel , Immanuel Trummer , Christopher Ré

We present a novel OCR-free document understanding framework based on pretrained Multimodal Large Language Models (MLLMs). Our approach employs multi-scale visual features to effectively handle various font sizes within document images. To…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Jaeyoo Park , Jin Young Choi , Jeonghyung Park , Bohyung Han

PDF documents have the potential to provide trillions of novel, high-quality tokens for training language models. However, these documents come in a diversity of types with differing formats and visual layouts that pose a challenge when…

While Large Language Models (LLMs) have significantly advanced code generation efficiency, they face inherent challenges in balancing performance and inference costs across diverse programming tasks. Dynamically selecting the optimal LLM…

Software Engineering · Computer Science 2025-06-13 Junhang Cheng , Fang Liu , Chengru Wu , Li Zhang

The automatic recognition of tabular data in document images presents a significant challenge due to the diverse range of table styles and complex structures. Tables offer valuable content representation, enhancing the predictive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Avinash Anand , Raj Jaiswal , Pijush Bhuyan , Mohit Gupta , Siddhesh Bangar , Md. Modassir Imam , Rajiv Ratn Shah , Shin'ichi Satoh

This paper proposes LayoutLLM, a more flexible document analysis method for understanding imaged documents. Visually Rich Document Understanding tasks, such as document image classification and information extraction, have gained…

Computation and Language · Computer Science 2024-03-22 Masato Fujitake

Large language models (LLMs) are becoming useful in many domains due to their impressive abilities that arise from large training datasets and large model sizes. However, research on LLM-based approaches to document inconsistency detection…

Computation and Language · Computer Science 2026-04-09 Nelvin Tan , Yaowen Zhang , James Asikin Cheung , Fusheng Liu , Yu-Ching Shih , Dong Yang

Large Language Models (LLMs) have achieved remarkable success across diverse applications, yet their deployment remains challenging due to substantial computational costs, memory requirements, and energy consumption. Recent empirical…

Machine Learning · Computer Science 2026-03-24 Kaito Tanaka , Masato Ito , Yuji Nishimura , Keisuke Matsuda , Aya Nakayama

Reliably extracting tables from PDFs is essential for large-scale scientific data mining and knowledge base construction, yet existing evaluation approaches rely on rule-based metrics that fail to capture semantic equivalence of table…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Pius Horn , Janis Keuper

Visually Rich Document Understanding (VRDU) has become a pivotal area of research, driven by the need to automatically interpret documents that contain intricate visual, textual, and structural elements. Recently, Multimodal Large Language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yihao Ding , Siwen Luo , Yue Dai , Yanbei Jiang , Zechuan Li , Qiang Sun , Geoffrey Martin , Wei Liu , Yifan Peng

Automatic legal judgment prediction and its explanation suffer from the problem of long case documents exceeding tens of thousands of words, in general, and having a non-uniform structure. Predicting judgments from such documents and…

Information Retrieval · Computer Science 2024-07-01 Nishchal Prasad , Mohand Boughanem , Taoufik Dkaki

Document retrieval is one of the most challenging tasks in Information Retrieval. It requires handling longer contexts, often resulting in higher query latency and increased computational overhead. Recently, Learned Sparse Retrieval (LSR)…

Information Retrieval · Computer Science 2025-04-09 Emmanouil Georgios Lionis , Jia-Huei Ju

We develop an abstractive summarization framework independent of labeled data for multiple heterogeneous documents. Unlike existing multi-document summarization methods, our framework processes documents telling different stories instead of…

Computation and Language · Computer Science 2022-05-03 Ning Wang , Han Liu , Diego Klabjan

Multimodal document understanding is a challenging task to process and comprehend large amounts of textual and visual information. Recent advances in Large Language Models (LLMs) have significantly improved the performance of this task.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xudong Xie , Hao Yan , Liang Yin , Yang Liu , Jing Ding , Minghui Liao , Yuliang Liu , Wei Chen , Xiang Bai

Document parsing is a fundamental task in multimodal understanding, supporting a wide range of downstream applications such as information extraction and intelligent document analysis. Benefiting from strong semantic modeling and robust…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Wenhui Liao , Hongliang Li , Pengyu Xie , Xinyu Cai , Yufan Shen , Yi Xin , Qi Qin , Shenglong Ye , Tianbin Li , Ming Hu , Junjun He , Yihao Liu , Wenhai Wang , Min Dou , Bin Fu , Botian Shi , Yu Qiao , Lianwen Jin

This paper presents ERPA, an innovative Robotic Process Automation (RPA) model designed to enhance ID data extraction and optimize Optical Character Recognition (OCR) tasks within immigration workflows. Traditional RPA solutions often face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Osama Abdellaif , Abdelrahman Nader , Ali Hamdi