English
Related papers

Related papers: Layout-Aware Information Extraction for Document-G…

200 papers

This paper proposes LayoutLLM, a more flexible document analysis method for understanding imaged documents. Visually Rich Document Understanding tasks, such as document image classification and information extraction, have gained…

Computation and Language · Computer Science 2024-03-22 Masato Fujitake

The volume of academic literature, such as academic conference papers and journals, has increased rapidly worldwide, and research on metadata extraction is ongoing. However, high-performing metadata extraction is still challenging due to…

Machine Learning · Computer Science 2021-12-24 Jongyun Choi , Hyesoo Kong , Hwamook Yoon , Heung-Seon Oh , Yuchul Jung

Constructing accurate knowledge graphs from long texts and low-resource languages is challenging, as large language models (LLMs) experience degraded performance with longer input chunks. This problem is amplified in low-resource settings…

Computation and Language · Computer Science 2025-03-25 Divyansh Singh , Manuel Nunez Martinez , Bonnie J. Dorr , Sonja Schmer Galunder

Current research in form understanding predominantly relies on large pre-trained language models, necessitating extensive data for pre-training. However, the importance of layout structure (i.e., the spatial relationship between the entity…

Computation and Language · Computer Science 2024-06-05 Pritika Ramu , Sijia Wang , Lalla Mouatadid , Joy Rimchala , Lifu Huang

Multiple entities in a document generally exhibit complex inter-sentence relations, and cannot be well handled by existing relation extraction (RE) methods that typically focus on extracting intra-sentence relations for single entity pairs.…

Computation and Language · Computer Science 2019-08-12 Yuan Yao , Deming Ye , Peng Li , Xu Han , Yankai Lin , Zhenghao Liu , Zhiyuan Liu , Lixin Huang , Jie Zhou , Maosong Sun

Invoices and receipts submitted by employees are visually rich documents (VRDs) with textual, visual and layout information. To protect against the risk of fraud and abuse, it is crucial for organizations to efficiently extract desired…

Computation and Language · Computer Science 2024-11-26 Aniket Bhattacharyya , Anurag Tripathi

Document understanding tasks, in particular, Visually-rich Document Entity Retrieval (VDER), have gained significant attention in recent years thanks to their broad applications in enterprise AI. However, publicly available data have been…

Computation and Language · Computer Science 2023-10-27 Lijun Yu , Jin Miao , Xiaoyu Sun , Jiayi Chen , Alexander G. Hauptmann , Hanjun Dai , Wei Wei

This study introduces a system leveraging Large Language Models (LLMs) to extract text and enhance user interaction with PDF documents via a conversational interface. Utilizing Retrieval-Augmented Generation (RAG), the system provides…

Information Retrieval · Computer Science 2025-02-20 Soham Roy , Mitul Goswami , Nisharg Nargund , Suneeta Mohanty , Prasant Kumar Pattnaik

Visually Rich Documents (VRDs) play a vital role in domains such as academia, finance, healthcare, and marketing, as they convey information through a combination of text, layout, and visual elements. Traditional approaches to extracting…

Computation and Language · Computer Science 2025-06-23 Yihao Ding , Soyeon Caren Han , Jean Lee , Eduard Hovy

Dialogue relation extraction (DRE) aims to extract relations between two arguments within a dialogue, which is more challenging than standard RE due to the higher person pronoun frequency and lower information density in dialogues. However,…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Zijie Xu , Ziyu Shang , Jiajun Liu , Ke Ji , Yikai Guo

Transformer-based Language Models are widely used in Natural Language Processing related tasks. Thanks to their pre-training, they have been successfully adapted to Information Extraction in business documents. However, most pre-training…

Computation and Language · Computer Science 2023-09-12 Thibault Douzon , Stefan Duffner , Christophe Garcia , Jérémy Espinas

Visual information extraction (VIE) plays an important role in Document Intelligence. Generally, it is divided into two tasks: semantic entity recognition (SER) and relation extraction (RE). Recently, pre-trained models for documents have…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chuwei Luo , Changxu Cheng , Qi Zheng , Cong Yao

Understanding visually-rich business documents to extract structured data and automate business workflows has been receiving attention both in academia and industry. Although recent multi-modal language models have achieved impressive…

Computation and Language · Computer Science 2023-09-19 Zilong Wang , Yichao Zhou , Wei Wei , Chen-Yu Lee , Sandeep Tata

Key information extraction (KIE) from visually rich documents (VRD) has been a challenging task in document intelligence because of not only the complicated and diverse layouts of VRD that make the model hard to generalize but also the lack…

Information Retrieval · Computer Science 2024-10-03 Panfeng Cao , Jian Wu

The increasing volume of scholarly publications requires advanced tools for efficient knowledge discovery and management. This paper introduces ongoing work on a system using Large Language Models (LLMs) for the semantic extraction of key…

Digital Libraries · Computer Science 2025-10-07 Samy Ateia , Udo Kruschwitz , Melanie Scholz , Agnes Koschmider , Moayad Almohaishi

Extracting structured information from visual documents (Visual Information Extraction, VIE) is a cornerstone of business automation. While recent Multimodal Large Language Models (MLLMs) have shown promising capabilities, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yandi Wang , Libin Zhan , Ziwei Huang , Tiancheng Luo , Yuxuan Jiang , Wang Dong , Leilei Gan , Jun Chen

We present the first human-annotated dialogue-based relation extraction (RE) dataset DialogRE, aiming to support the prediction of relation(s) between two arguments that appear in a dialogue. We further offer DialogRE as a platform for…

Computation and Language · Computer Science 2020-04-20 Dian Yu , Kai Sun , Claire Cardie , Dong Yu

Efficient and accurate extraction of electrical parameters from circuit datasheets and design documents is critical for accelerating circuit design in Electronic Design Automation (EDA). Traditional workflows often rely on engineers…

Hardware Architecture · Computer Science 2024-12-10 Hong Cai Chen , Longchang Wu , Ming Gao , Lingrui Shen , Jiarui Zhong , Yipin Xu

Visually Rich Document Understanding (VRDU) has emerged as a critical field in document intelligence, enabling automated extraction of key information from complex documents across domains such as medical, financial, and educational…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yihao Ding , Soyeon Caren Han , Yan Li , Josiah Poon

Deep learning-based approaches for automatic document layout analysis and content extraction have the potential to unlock rich information trapped in historical documents on a large scale. One major hurdle is the lack of large datasets for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Zejiang Shen , Kaixuan Zhang , Melissa Dell