English
Related papers

Related papers: LongFin: A Multimodal Document Understanding Model…

200 papers

Generating professional financial reports is a labor-intensive and intellectually demanding process that current AI systems struggle to fully automate. To address this challenge, we introduce FinSight (Financial InSight), a novel multi…

Computation and Language · Computer Science 2025-10-21 Jiajie Jin , Yuyao Zhang , Yimeng Xu , Hongjin Qian , Yutao Zhu , Zhicheng Dou

Current multimodal large language models (MLLMs) face significant challenges in visual document understanding (VDU) tasks due to the high resolution, dense text, and complex layouts typical of document images. These characteristics demand a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jiaxin Zhang , Wentao Yang , Songxuan Lai , Zecheng Xie , Lianwen Jin

Traditional banks face increasing competition from FinTechs in the rapidly evolving financial ecosystem. Raising operational efficiency is vital to address this challenge. Our study aims to improve the efficiency of document-intensive…

Computation and Language · Computer Science 2023-11-28 Christopher Gerling , Stefan Lessmann

Foundation models, such as large language models (LLMs), have the potential to streamline evaluation workflows and improve their performance. However, practical adoption faces challenges, such as customisability, accuracy, and scalability.…

Information Retrieval · Computer Science 2025-11-11 Hao Zhang , Qinghua Lu , Liming Zhu

Transformer-based models have achieved remarkable success in various Natural Language Processing (NLP) tasks, yet their ability to handle long documents is constrained by computational limitations. Traditional approaches, such as truncating…

Computation and Language · Computer Science 2025-08-21 Yan Li , Soyeon Caren Han , Yue Dai , Feiqi Cao

Document understanding is a key business process in the data-driven economy since documents are central to knowledge discovery and business insights. Converting documents into a machine-processable format is a particular challenge here due…

Digital Libraries · Computer Science 2022-07-14 Christoph Auer , Michele Dolfi , André Carvalho , Cesar Berrospi Ramis , Peter W. J. Staar

Long-document topic segmentation plays an important role in information retrieval and document understanding, yet existing methods still show clear shortcomings in ultra-long text settings. Traditional discriminative models are constrained…

Computation and Language · Computer Science 2026-03-02 Kaifeng Wu , Junyan Wu , Qiang Liu , Jiarui Zhang , Wen Xu

Despite several successes in document understanding, the practical task for long document understanding is largely under-explored due to several challenges in computation and how to efficiently absorb long multimodal input. Most current…

Computation and Language · Computer Science 2022-08-18 Hai Pham , Guoxin Wang , Yijuan Lu , Dinei Florencio , Cha Zhang

We present DocFormer -- a multi-modal transformer based architecture for the task of Visual Document Understanding (VDU). VDU is a challenging problem which aims to understand documents in their varied formats (forms, receipts etc.) and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Srikar Appalaraju , Bhavan Jasani , Bhargava Urala Kota , Yusheng Xie , R. Manmatha

Scientific documents record research findings and valuable human knowledge, comprising a vast corpus of high-quality data. Leveraging multi-modality data extracted from these documents and assessing large models' abilities to handle…

Typically, information extraction (IE) requires a pipeline approach: first, a sequence labeling model is trained on manually annotated documents to extract relevant spans; then, when a new document arrives, a model predicts spans which are…

Computation and Language · Computer Science 2021-10-12 Benjamin Townsend , Eamon Ito-Fisher , Lily Zhang , Madison May

Document understanding in real-world applications often requires processing heterogeneous, multi-page document packets containing multiple documents stitched together. Despite recent advances in visual document understanding, the…

Document parsing is essential for analyzing complex document structures and extracting fine-grained information, supporting numerous downstream applications. However, existing methods often require integrating multiple independent models to…

Computation and Language · Computer Science 2025-05-23 Mingxu Chai , Ziyu Shen , Chong Zhang , Yue Zhang , Xiao Wang , Shihan Dou , Jihua Kang , Jiazheng Zhang , Qi Zhang

Successful Artificial Intelligence systems often require numerous labeled data to extract information from document images. In this paper, we investigate the problem of improving the performance of Artificial Intelligence systems in…

Information Retrieval · Computer Science 2022-09-27 Bao-Sinh Nguyen , Dung Tien Le , Hieu M. Vu , Tuan Anh D. Nguyen , Minh-Tien Nguyen , Hung Le

As financial institutions and professionals increasingly incorporate Large Language Models (LLMs) into their workflows, substantial barriers, including proprietary data and specialized knowledge, persist between the finance sector and the…

Statistical Finance · Quantitative Finance 2024-05-28 Hongyang Yang , Boyu Zhang , Neng Wang , Cheng Guo , Xiaoli Zhang , Likun Lin , Junlin Wang , Tianyu Zhou , Mao Guan , Runjia Zhang , Christina Dan Wang

Background: Recent advancements in large language models (LLMs) offer potential benefits in healthcare, particularly in processing extensive patient records. However, existing benchmarks do not fully assess LLMs' capability in handling…

The financial domain frequently deals with large numbers of long documents that are essential for daily operations. Significant effort is put towards automating financial data analysis. However, a persistent challenge, not limited to the…

Computation and Language · Computer Science 2024-06-21 Viet Dac Lai , Michael Krumdick , Charles Lovering , Varshini Reddy , Craig Schmidt , Chris Tanner

Despite significant progress in multimodal large language models (MLLMs), their performance on complex, multi-page document comprehension remains inadequate, largely due to the lack of high-quality, document-level datasets. While current…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yuchen Duan , Zhe Chen , Yusong Hu , Weiyun Wang , Shenglong Ye , Botian Shi , Lewei Lu , Qibin Hou , Tong Lu , Hongsheng Li , Jifeng Dai , Wenhai Wang

Document image parsing is challenging due to its complexly intertwined elements such as text paragraphs, figures, formulas, and tables. Current approaches either assemble specialized expert models or directly generate page-level content…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Hao Feng , Shu Wei , Xiang Fei , Wei Shi , Yingdong Han , Lei Liao , Jinghui Lu , Binghong Wu , Qi Liu , Chunhui Lin , Jingqun Tang , Hao Liu , Can Huang

Large Language Models (LLMs) have demonstrated remarkable capabilities in handling long texts and have almost perfect performance in traditional retrieval tasks. However, their performance significantly degrades when it comes to numerical…

Computation and Language · Computer Science 2024-12-05 Yijiong Yu