English
Related papers

Related papers: ViBERTgrid BiLSTM-CRF: Multimodal Key Information …

200 papers

Structured text understanding on Visually Rich Documents (VRDs) is a crucial part of Document Intelligence. Due to the complexity of content and layout in VRDs, structured text understanding has been a challenging task. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Yulin Li , Yuxi Qian , Yuchen Yu , Xiameng Qin , Chengquan Zhang , Yan Liu , Kun Yao , Junyu Han , Jingtuo Liu , Errui Ding

There is a growing demand in the field of KIE (Key Information Extraction) to apply semi-supervised learning to save manpower and costs, as training document data using fully-supervised methods requires labor-intensive manual annotation.…

Machine Learning · Computer Science 2024-07-24 Qi Zhang , Yonghong Song , Pengcheng Guo , Yangyang Hui

Large Language Models (LLMs) demonstrate exceptional performance in textual understanding and tabular reasoning tasks. However, their ability to comprehend and analyze hybrid text, containing textual and tabular data, remains unexplored.…

Computation and Language · Computer Science 2025-01-03 Chongjian Yue , Xinrun Xu , Xiaojun Ma , Lun Du , Zhiming Ding , Shi Han , Dongmei Zhang , Qi Zhang

Foundation models (FMs) are able to leverage large volumes of unlabeled data to demonstrate superior performance across a wide range of tasks. However, FMs developed for biomedical domains have largely remained unimodal, i.e., independently…

Recent studies have demonstrated advantages of information fusion based on sparsity models for multimodal classification. Among several sparsity models, tree-structured sparsity provides a flexible framework for extraction of…

Computer Vision and Pattern Recognition · Computer Science 2015-02-04 Soheil Bahrampour , Asok Ray , Nasser M. Nasrabadi , Kenneth W. Jenkins

We propose an unsupervised keyphrase extraction model that encodes topical information within a multipartite graph structure. Our model represents keyphrase candidates and topics in a single graph and exploits their mutually reinforcing…

Information Retrieval · Computer Science 2018-04-17 Florian Boudin

Existing methods for Visual Information Extraction (VIE) from form-like documents typically fragment the process into separate subtasks, such as key information extraction, key-value pair extraction, and choice group extraction. However,…

Computation and Language · Computer Science 2024-01-18 Kai Hu , Jiawei Wang , Weihong Lin , Zhuoyao Zhong , Lei Sun , Qiang Huo

We present FinTree, Financial Dataset Pretrain Transformer Encoder for Relation Extraction. Utilizing an encoder language model, we further pretrain FinTree on the financial dataset, adapting the model in financial domain tasks. FinTree…

Computation and Language · Computer Science 2023-07-27 Hyunjong Ok

Multimodal information extraction (MIE) constitutes a set of essential tasks aimed at extracting structural information from Web texts with integrating images, to facilitate the structural construction of Web-based semantic knowledge. To…

Multimedia · Computer Science 2026-03-18 Baohang Zhou , Kehui Song , Rize Jin , Yu Zhao , Xuhui Sui , Xinying Qian , Xingyue Guo , Ying Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities in text comprehension, but their ability to process complex, hierarchical tabular data remains underexplored. We present a novel approach to extracting structured data…

Computation and Language · Computer Science 2025-11-25 Vikram Aggarwal , Jay Kulkarni , Aditi Mascarenhas , Aakriti Narang , Siddarth Raman , Ajay Shah , Susan Thomas

Manual chart review remains an extremely time-consuming and resource-intensive component of clinical research, requiring experts to extract often complex information from unstructured electronic health record (EHR) narratives. We present a…

Existing scholarly information extraction (SIE) datasets focus on scientific papers and overlook implementation-level details in code repositories. README files describe datasets, source code, and other implementation-level artifacts,…

Computation and Language · Computer Science 2026-03-09 Genet Asefa Gesese , Zongxiong Chen , Shufan Jiang , Mary Ann Tan , Zhaotai Liu , Sonja Schimmler , Harald Sack

Unstructured data, especially text, continues to grow rapidly in various domains. In particular, in the financial sphere, there is a wealth of accumulated unstructured financial data, such as the textual disclosure documents that companies…

Computation and Language · Computer Science 2024-04-18 Bolun "Namir" Xia , Vipula D. Rawte , Mohammed J. Zaki , Aparna Gupta

Document-level relation extraction (DocRE) aims to extract relations of all entity pairs in a document. A key challenge in DocRE is the cost of annotating such data which requires intensive human effort. Thus, we investigate the case of…

Computation and Language · Computer Science 2023-10-13 Minseok Choi , Hyesu Lim , Jaegul Choo

Electronic health records (EHRs) contain structured and unstructured data of significant clinical and research value. Various machine learning approaches have been developed to employ information in EHRs for risk prediction. The majority of…

Constructing large-scaled medical knowledge graphs can significantly boost healthcare applications for medical surveillance, bring much attention from recent research. An essential step in constructing large-scale MKG is extracting…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jialun Wu , Yang Liu , Zeyu Gao , Tieliang Gong , Chunbao Wang , Chen Li

Document AI is a growing research field that focuses on the comprehension and extraction of information from scanned and digital documents to make everyday business operations more efficient. Numerous downstream tasks and datasets have been…

Computation and Language · Computer Science 2024-01-29 Ahmed Masry , Amir Hajian

Advancements in Large Language Models (LLMs) have extended their input context length, yet they still struggle with retrieval and reasoning in long-context inputs. Existing methods propose to utilize the prompt strategy and retrieval head…

Computation and Language · Computer Science 2025-05-16 Han Peng , Jinhao Jiang , Zican Dong , Wayne Xin Zhao , Lei Fang

Multimodal information extraction (MIE) is crucial for scientific literature, where valuable data is often spread across text, figures, and tables. In materials science, extracting structured information from research articles can…

Computation and Language · Computer Science 2024-10-29 Ghazal Khalighinejad , Sharon Scott , Ollie Liu , Kelly L. Anderson , Rickard Stureborg , Aman Tyagi , Bhuwan Dhingra

Current state-of-the-art approaches for named entity recognition (NER) typically consider text at the sentence-level and thus do not model information that crosses sentence boundaries. However, the use of transformer-based models for NER…

Computation and Language · Computer Science 2021-05-17 Stefan Schweter , Alan Akbik