English
Related papers

Related papers: FinMR: A Knowledge-Intensive Multimodal Benchmark …

200 papers

We present FinMMR, a novel bilingual multimodal benchmark tailored to evaluate the reasoning capabilities of multimodal large language models (MLLMs) in financial numerical reasoning tasks. Compared to existing benchmarks, our work…

While Large Multimodal Models (LMMs) excel in general visual tasks, their deployment in specialized financial contexts remains insufficient. Existing benchmarks prioritize isolated charts, often overlooking the need to integrate data from…

Computational Engineering, Finance, and Science · Computer Science 2026-05-19 Jiayong Zhu , Jiangtong Li , Jinru Ding , Dawei Cheng , Jie Xu , Feng Yu

Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years. However, in the financial domain, there is a notable lack of effective and specialized multimodal evaluation datasets. To advance the development…

Computation and Language · Computer Science 2025-06-02 Junyu Luo , Zhizhuo Kou , Liming Yang , Xiao Luo , Jinsheng Huang , Zhiping Xiao , Jingshu Peng , Chengzhong Liu , Jiaming Ji , Xuanzhe Liu , Sirui Han , Ming Zhang , Yike Guo

We introduce FinMMDocR, a novel bilingual multimodal benchmark for evaluating multimodal large language models (MLLMs) on real-world financial numerical reasoning. Compared to existing benchmarks, our work delivers three major advancements.…

Effective financial reasoning demands not only textual understanding but also the ability to interpret complex visual data such as charts, tables, and trend graphs. This paper introduces a new benchmark designed to evaluate how well AI…

Artificial Intelligence · Computer Science 2025-06-10 Shuangyan Deng , Haizhou Peng , Jiachen Xu , Chunhou Liu , Ciprian Doru Giurcuaneanu , Jiamou Liu

Real-world decision-making often requires integrating and reasoning over information from multiple modalities. While recent multimodal large language models (MLLMs) have shown promise in such tasks, their ability to perform multi-hop…

Computation and Language · Computer Science 2025-06-02 Seunghee Kim , Changhyeon Kim , Taeuk Kim

Real-world financial analysis involves information across multiple languages and modalities, from reports and news to scanned filings and meeting recordings. Yet most existing evaluations of LLMs in finance remain text-only, monolingual,…

Large Language Models (LLMs) demonstrate significant potential but face challenges in complex financial reasoning tasks requiring both domain knowledge and sophisticated reasoning. Current evaluation benchmarks often fall short by not…

Computation and Language · Computer Science 2025-11-07 Shaoyu Dou , Yutian Shen , Mofan Chen , Zixuan Wang , Jiajie Xu , Qi Guo , Kailai Shao , Chao Chen , Haixiang Hu , Haibo Shi , Min Min , Liwen Zhang

The financial domain poses substantial challenges for vision-language models (VLMs) due to specialized chart formats and knowledge-intensive reasoning requirements. However, existing financial benchmarks are largely single-turn and rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Chenxi Zhang , Ziliang Gan , Liyun Zhu , Youwei Pang , Qing Zhang , Rongjunchen Zhang

Multimodal Large Language Models (MLLMs) have rapidly evolved with the growth of Large Language Models (LLMs) and are now applied in various fields. In finance, the integration of diverse modalities such as text, charts, and tables is…

Computation and Language · Computer Science 2025-06-17 Jiangtong Li , Yiyun Zhu , Dawei Cheng , Zhijun Ding , Changjun Jiang

Multi-modal Large Language Models (MLLMs) are increasingly prominent in the field of artificial intelligence. These models not only excel in traditional vision-language tasks but also demonstrate impressive performance in contemporary…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Xiaotian Han , Quanzeng You , Yongfei Liu , Wentao Chen , Huangjie Zheng , Khalil Mrini , Xudong Lin , Yiqi Wang , Bohan Zhai , Jianbo Yuan , Heng Wang , Hongxia Yang

Solving financial problems demands complex reasoning, multimodal data processing, and a broad technical understanding, presenting unique challenges for current large language models (LLMs). We introduce XFinBench, a novel benchmark with…

Computation and Language · Computer Science 2025-08-25 Zhihan Zhang , Yixin Cao , Lizi Liao

Large Multimodal Models (LMMs) demonstrate significant cross-modal reasoning capabilities. However, financial applications face challenges due to the lack of high-quality multimodal reasoning datasets and the inefficiency of existing…

Computation and Language · Computer Science 2025-06-17 Kai Lan , Jiayong Zhu , Jiangtong Li , Dawei Cheng , Guang Chen , Changjun Jiang

We introduce MRMR, the first expert-level multidisciplinary multimodal retrieval benchmark requiring intensive reasoning. MRMR contains 1,502 queries spanning 23 domains, with positive documents carefully verified by human experts. Compared…

Information Retrieval · Computer Science 2026-02-17 Siyue Zhang , Yuan Gao , Xiao Zhou , Yilun Zhao , Tingyu Song , Arman Cohan , Anh Tuan Luu , Chen Zhao

Financial tasks are pivotal to global economic stability; however, their execution faces challenges including labor intensive processes, low error tolerance, data fragmentation, and tool limitations. Although large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-21 Junzhe Jiang , Chang Yang , Aixin Cui , Sihan Jin , Ruiyu Wang , Bo Li , Xiao Huang , Dongning Sun , Xinrun Wang

Multimodal large language models are playing an increasingly significant role in empowering the financial domain, however, the challenges they face, such as multimodal and high-density information and cross-modal multi-hop reasoning, go…

In recent years, multimodal benchmarks for general domains have guided the rapid development of multimodal models on general tasks. However, the financial field has its peculiarities. It features unique graphical images (e.g., candlestick…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Ziliang Gan , Yu Lu , Dong Zhang , Haohan Li , Che Liu , Jian Liu , Ji Liu , Haipang Wu , Chaoyou Fu , Zenglin Xu , Rongjunchen Zhang , Yong Dai

With enhanced capabilities and widespread applications, Multimodal Large Language Models (MLLMs) are increasingly required to process and reason over multiple images simultaneously. However, existing MLLM benchmarks focus either on…

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks. However, their proficiency and reliability in the specialized domain of financial data analysis, particularly focusing on data-driven…

Computation and Language · Computer Science 2024-06-17 Shu Liu , Shangqing Zhao , Chenghao Jia , Xinlin Zhuang , Zhaoguang Long , Jie Zhou , Aimin Zhou , Man Lan , Qingquan Wu , Chong Yang

In recent years, Large Language Models (LLMs) have demonstrated remarkable versatility across various applications, including natural language understanding, domain-specific knowledge tasks, etc. However, applying LLMs to complex,…

Computation and Language · Computer Science 2024-11-12 Xinqi Yang , Scott Zang , Yong Ren , Dingjie Peng , Zheng Wen
‹ Prev 1 2 3 10 Next ›