English
Related papers

Related papers: FinCriticalED: A Visual Benchmark for Financial Fa…

200 papers

While Large Multimodal Models (LMMs) excel in general visual tasks, their deployment in specialized financial contexts remains insufficient. Existing benchmarks prioritize isolated charts, often overlooking the need to integrate data from…

Computational Engineering, Finance, and Science · Computer Science 2026-05-19 Jiayong Zhu , Jiangtong Li , Jinru Ding , Dawei Cheng , Jie Xu , Feng Yu

Multimodal Large Language Models (MLLMs) have made substantial progress in recent years. However, their rigorous evaluation within specialized domains like finance is hindered by the absence of datasets characterized by professional-level…

Artificial Intelligence · Computer Science 2025-11-25 Shuangyan Deng , Haizhou Peng , Jiachen Xu , Rui Mao , Ciprian Doru Giurcăneanu , Jiamou Liu

Scoring the Optical Character Recognition (OCR) capabilities of Large Multimodal Models (LMMs) has witnessed growing interest. Existing benchmarks have highlighted the impressive performance of LMMs in text recognition; however, their…

Real-world financial analysis involves information across multiple languages and modalities, from reports and news to scanned filings and meeting recordings. Yet most existing evaluations of LLMs in finance remain text-only, monolingual,…

Large Multimodal Models (LMMs) have recently shown strong performance on Optical Character Recognition (OCR) tasks, demonstrating their promising capability in document literacy. However, their effectiveness in real-world applications…

Computation and Language · Computer Science 2026-05-06 Zhipeng Xu , Junhao Ji , Zulong Chen , Zhenghao Liu , Qing Liu , Chunyi Peng , Zubao Qin , Ze Xu , Jianqiang Wan , Jun Tang , Zhibo Yang , Shuai Bai , Dayiheng Liu

Large Multimodal Models (LMMs) have demonstrated impressive performance in recognizing document images with natural language instructions. However, it remains unclear to what extent capabilities in literacy with rich structure and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Zhibo Yang , Jun Tang , Zhaohai Li , Pengfei Wang , Jianqiang Wan , Humen Zhong , Xuejing Liu , Mingkun Yang , Peng Wang , Shuai Bai , LianWen Jin , Junyang Lin

Recent advancements in multimodal slow-thinking systems have demonstrated remarkable performance across various visual reasoning tasks. However, their capabilities in text-rich image reasoning tasks remain understudied due to the absence of…

Machine Learning · Computer Science 2026-05-27 Mingxin Huang , Yongxin Shi , Dezhi Peng , Songxuan Lai , Zecheng Xie , Lianwen Jin

With the rise of multimodal large language models, accurately extracting and understanding textual information from video content, referred to as video based optical character recognition (Video OCR), has become a crucial capability. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yulin Fei , Yuhui Gao , Xingyuan Xian , Xiaojin Zhang , Tao Wu , Wei Chen

We introduce FinMMDocR, a novel bilingual multimodal benchmark for evaluating multimodal large language models (MLLMs) on real-world financial numerical reasoning. Compared to existing benchmarks, our work delivers three major advancements.…

DeepSeek-OCR utilizes an optical 2D mapping approach to achieve high-ratio vision-text compression, claiming to decode text tokens exceeding ten times the input visual tokens. While this suggests a promising solution for the LLM…

Computation and Language · Computer Science 2026-01-09 Yunhao Liang , Ruixuan Ying , Bo Li , Hong Li , Kai Yan , Qingwen Li , Min Yang , Okamoto Satoshi , Zhe Cui , Shiwen Ni

With the increasing deployment of Large Language Models (LLMs) in the finance domain, LLMs are increasingly expected to parse complex regulatory disclosures. However, existing benchmarks often focus on isolated details, failing to reflect…

Computational Engineering, Finance, and Science · Computer Science 2026-02-17 Yidong Jiang , Junrong Chen , Eftychia Makri , Jialin Chen , Peiwen Li , Ali Maatouk , Leandros Tassiulas , Eliot Brenner , Bing Xiang , Rex Ying

Financial documents are essential sources of information for regulators, auditors, and financial institutions, particularly for assessing the wealth and compliance of Small and Medium-sized Businesses. However, SMB documents are often…

Information Retrieval · Computer Science 2025-10-28 Yichao Jin , Yushuo Wang , Qishuai Zhong , Kent Chiu Jin-Chun , Kenneth Zhu Ke , Donald MacDonald

Multimodal Large Language Models (MLLMs) have achieved considerable accuracy in Optical Character Recognition (OCR) from static images. However, their efficacy in video OCR is significantly diminished due to factors such as motion blur,…

Recent advances in Large Multimodal Models (LMMs) have revolutionized their reasoning and Optical Character Recognition (OCR) capabilities. However, their complex logical reasoning performance on text-rich images remains underexplored. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Maoyuan Ye , Haibin He , Qihuang Zhong , Jing Zhang , Juhua Liu , Bo Du

Accurate transcription of handwritten mathematics is crucial for educational AI systems, yet current benchmarks fail to evaluate this capability properly. Most prior studies focus on single-line expressions and rely on lexical metrics such…

Computers and Society · Computer Science 2026-05-27 Jin Seong , Wencke Liermann , Minho Kim , Jong-hun Shin , Soojong Lim

This paper introduces an open-source benchmark for evaluating Vision-Language Models (VLMs) on Optical Character Recognition (OCR) tasks in dynamic video environments. We present a curated dataset containing 1,477 manually annotated frames…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Sankalp Nagaonkar , Augustya Sharma , Ashish Choithani , Ashutosh Trivedi

Large vision-language models (LVLMs) have made significant progress in chart understanding. However, financial charts, characterized by complex temporal structures and domain-specific terminology, remain notably underexplored. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dong Shu , Haoyang Yuan , Yuchen Wang , Yanguang Liu , Huopu Zhang , Haiyan Zhao , Mengnan Du

We present FireRed-OCR, a systematic framework to specialize general VLMs into high-performance OCR models. Large Vision-Language Models (VLMs) have demonstrated impressive general capabilities but frequently suffer from ``structural…

Large vision-language models (LVLMs) have significantly improved multimodal reasoning tasks, such as visual question answering and image captioning. These models embed multimodal facts within their parameters, rather than relying on…

Computation and Language · Computer Science 2025-02-18 Shengkang Wang , Hongzhan Lin , Ziyang Luo , Zhen Ye , Guang Chen , Jing Ma

Optical character recognition (OCR) and multilingual text understanding remain major failure modes of multimodal large language models (MLLMs), particularly in real-world images containing cluttered layouts, small fonts, blur, occlusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Qinwu Xu , Yifan Jiang , Haoyu Ren
‹ Prev 1 2 3 10 Next ›