English
Related papers

Related papers: Open-FinLLMs: Open Multimodal Large Language Model…

200 papers

This paper presents a novel study on harnessing Large Language Models' (LLMs) outstanding knowledge and reasoning abilities for explainable financial time series forecasting. The application of machine learning models to financial time…

Machine Learning · Computer Science 2023-06-21 Xinli Yu , Zheng Chen , Yuan Ling , Shujing Dong , Zongyi Liu , Yanbin Lu

As large language models (LLMs) increasingly permeate the financial sector, there is a pressing need for a standardized method to comprehensively assess their performance. Existing financial benchmarks often suffer from limited language and…

Computation and Language · Computer Science 2025-12-09 Xiaojun Wu , Junxi Liu , Huanyi Su , Zhouchi Lin , Yiyan Qi , Chengjin Xu , Jiajun Su , Jiajie Zhong , Fuwei Wang , Saizhuo Wang , Fengrui Hua , Jia Li , Jian Guo

In recent years, multimodal benchmarks for general domains have guided the rapid development of multimodal models on general tasks. However, the financial field has its peculiarities. It features unique graphical images (e.g., candlestick…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Ziliang Gan , Yu Lu , Dong Zhang , Haohan Li , Che Liu , Jian Liu , Ji Liu , Haipang Wu , Chaoyou Fu , Zenglin Xu , Rongjunchen Zhang , Yong Dai

Recent releases of pre-trained Large Language Models (LLMs) have gained considerable traction, yet research on fine-tuning and employing domain-specific LLMs remains scarce. This study investigates approaches for fine-tuning and leveraging…

Computation and Language · Computer Science 2024-05-29 Cheonsu Jeong

With the rapid development of large language models (LLMs) and their integration into large multimodal models (LMMs), there has been impressive progress in zero-shot completion of user-oriented vision-language tasks. However, a gap remains…

Computation and Language · Computer Science 2024-04-16 Fuxiao Liu , Xiaoyang Wang , Wenlin Yao , Jianshu Chen , Kaiqiang Song , Sangwoo Cho , Yaser Yacoob , Dong Yu

Large Multimodal Models (LMMs) demonstrate significant cross-modal reasoning capabilities. However, financial applications face challenges due to the lack of high-quality multimodal reasoning datasets and the inefficiency of existing…

Computation and Language · Computer Science 2025-06-17 Kai Lan , Jiayong Zhu , Jiangtong Li , Dawei Cheng , Guang Chen , Changjun Jiang

Large language models (LLMs) have demonstrated impressive reasoning capabilities, particularly in textual mathematical problem-solving. However, existing open-source image instruction fine-tuning datasets, containing limited question-answer…

Computation and Language · Computer Science 2024-10-10 Wenhao Shi , Zhiqiang Hu , Yi Bin , Junhua Liu , Yang Yang , See-Kiong Ng , Lidong Bing , Roy Ka-Wei Lee

We introduce FinanceMath, a novel benchmark designed to evaluate LLMs' capabilities in solving knowledge-intensive math reasoning problems. Compared to prior works, this study features three core advancements. First, FinanceMath includes…

Computation and Language · Computer Science 2024-08-09 Yilun Zhao , Hongjun Liu , Yitao Long , Rui Zhang , Chen Zhao , Arman Cohan

Multimodal LLMs (MLLMs) are capable of performing complex data analysis, visual question answering, generation, and reasoning tasks. However, their ability to analyze biometric data is relatively underexplored. In this work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ekta Gavas , Sudipta Banerjee , Chinmay Hegde , Nasir Memon

Recently, many versatile Multi-modal Large Language Models (MLLMs) have emerged continuously. However, their capacity to query information depicted in visual charts and engage in reasoning based on the queried contents remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Renqiu Xia , Bo Zhang , Hancheng Ye , Xiangchao Yan , Qi Liu , Hongbin Zhou , Zijun Chen , Peng Ye , Min Dou , Botian Shi , Junchi Yan , Yu Qiao

In an era defined by the explosive growth of data and rapid technological advancements, Multimodal Large Language Models (MLLMs) stand at the forefront of artificial intelligence (AI) systems. Designed to seamlessly integrate diverse data…

The rapid advancements in Large Language Models (LLMs) have unlocked transformative possibilities in natural language processing, particularly within the financial sector. Financial data is often embedded in intricate relationships across…

Statistical Finance · Quantitative Finance 2026-05-21 Alejandro Lopez-Lira , Jihoon Kwon , Sangwoon Yoon , Jy-yong Sohn , Chanyeol Choi

Recent LLMs have demonstrated promising ability in solving finance related problems. However, applying LLMs in real-world finance application remains challenging due to its high risk and high stakes property. This paper introduces FinTrust,…

Machine Learning · Computer Science 2025-10-20 Tiansheng Hu , Tongyan Hu , Liuyang Bai , Yilun Zhao , Arman Cohan , Chen Zhao

Financial report generation tasks range from macro- to micro-economics analysis, also requiring extensive data analysis. Existing LLM models are usually fine-tuned on simple QA tasks and cannot comprehensively analyze real financial…

Computational Engineering, Finance, and Science · Computer Science 2025-07-15 Yingqian Wu , Qiushi Wang , Zefei Long , Rong Ye , Zhongtian Lu , Xianyin Zhang , Bingxuan Li , Wei Chen , Liwen Zhang , Zhongyu Wei

Large language models (LLMs) have demonstrated great potential in the financial domain. Thus, it becomes important to assess the performance of LLMs in the financial tasks. In this work, we introduce CFBenchmark, to evaluate the performance…

Computation and Language · Computer Science 2024-05-22 Yang Lei , Jiangtong Li , Dawei Cheng , Zhijun Ding , Changjun Jiang

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

Computation and Language · Computer Science 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

The integration of Large Language Models (LLMs) into the financial domain is driving a paradigm shift from passive information retrieval to dynamic, agentic interaction. While general-purpose tool learning has witnessed a surge in…

Artificial Intelligence · Computer Science 2026-03-10 Jiaxuan Lu , Kong Wang , Yemin Wang , Qingmei Tang , Hongwei Zeng , Xiang Chen , Jiahao Pi , Shujian Deng , Lingzhi Chen , Yi Fu , Kehua Yang , Xiao Sun

The proliferation of complex structured data in hybrid sources, such as PDF documents and web pages, presents unique challenges for current Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) in providing accurate…

Information Retrieval · Computer Science 2025-08-22 Shivani Upadhyay , Messiah Ataey , Syed Shariyar Murtaza , Yifan Nie , Jimmy Lin

A number of tasks have been proposed recently to facilitate easy access to charts such as chart QA and summarization. The dominant paradigm to solve these tasks has been to fine-tune a pretrained model on the task data. However, this…

Computation and Language · Computer Science 2023-12-19 Xuan Long Do , Mohammad Hassanpour , Ahmed Masry , Parsa Kavehzadeh , Enamul Hoque , Shafiq Joty

Multimodal Large Language Models (MLLMs) have demonstrated impressive abilities across various tasks, including visual question answering and chart comprehension, yet existing benchmarks for chart-related tasks fall short in capturing the…

Computation and Language · Computer Science 2025-02-11 Zifeng Zhu , Mengzhao Jia , Zhihan Zhang , Lang Li , Meng Jiang