English
Related papers

Related papers: Multimodal Financial Foundation Models (MFFMs): Pr…

200 papers

Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years. However, in the financial domain, there is a notable lack of effective and specialized multimodal evaluation datasets. To advance the development…

Computation and Language · Computer Science 2025-06-02 Junyu Luo , Zhizhuo Kou , Liming Yang , Xiao Luo , Jinsheng Huang , Zhiping Xiao , Jingshu Peng , Chengzhong Liu , Jiaming Ji , Xuanzhe Liu , Sirui Han , Ming Zhang , Yike Guo

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Large Language Models (LLMs) have recently emerged as a focal point of research and application, driven by their unprecedented ability to understand and generate text with human-like quality. Even more recently, LLMs have been extended into…

Computation and Language · Computer Science 2024-04-03 Kilian Carolan , Laura Fennelly , Alan F. Smeaton

We present the setup and the tasks of the FinMMEval Lab at CLEF 2026, which introduces the first multilingual and multimodal evaluation framework for financial Large Language Models (LLMs). While recent advances in financial natural…

As financial institutions and professionals increasingly incorporate Large Language Models (LLMs) into their workflows, substantial barriers, including proprietary data and specialized knowledge, persist between the finance sector and the…

Statistical Finance · Quantitative Finance 2024-05-28 Hongyang Yang , Boyu Zhang , Neng Wang , Cheng Guo , Xiaoli Zhang , Likun Lin , Junlin Wang , Tianyu Zhou , Mao Guan , Runjia Zhang , Christina Dan Wang

Multimodal Large Language Models (MLLMs) have made substantial progress in recent years. However, their rigorous evaluation within specialized domains like finance is hindered by the absence of datasets characterized by professional-level…

Artificial Intelligence · Computer Science 2025-11-25 Shuangyan Deng , Haizhou Peng , Jiachen Xu , Rui Mao , Ciprian Doru Giurcăneanu , Jiamou Liu

Artificial intelligence is making significant strides in the finance industry, revolutionizing how data is processed and interpreted. Among these technologies, large language models (LLMs) have demonstrated substantial potential to…

Computation and Language · Computer Science 2024-07-02 Cehao Yang , Chengjin Xu , Yiyan Qi

The financial industry's growing demand for advanced natural language processing (NLP) capabilities has highlighted the limitations of generalist large language models (LLMs) in handling domain-specific financial tasks. To address this gap,…

Statistical Finance · Quantitative Finance 2025-11-13 Gaëtan Caillaut , Raheel Qader , Jingshu Liu , Mariam Nakhlé , Arezki Sadoune , Massinissa Ahmim , Jean-Gabriel Barthelemy

Financial misinformation poses significant threats to financial market stability and individuals' investment decisions. The multilingual environment and the inherent complexity of financial information present substantial challenges for…

Computational Engineering, Finance, and Science · Computer Science 2026-04-21 Zhiwei Liu , Yuyan Wang , Yuechen Jiang , Yupeng Cao , Tianlei Zhu , Xiaorui Guo , Zhiyang Deng , Zhiyuan Yao , Xiao-Yang Liu , Jimin Huang , Sophia Ananiadou

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks. However, their proficiency and reliability in the specialized domain of financial data analysis, particularly focusing on data-driven…

Computation and Language · Computer Science 2024-06-17 Shu Liu , Shangqing Zhao , Chenghao Jia , Xinlin Zhuang , Zhaoguang Long , Jie Zhou , Aimin Zhou , Man Lan , Qingquan Wu , Chong Yang

In this paper, we propose FinVis-GPT, a novel multimodal large language model (LLM) specifically designed for financial chart analysis. By leveraging the power of LLMs and incorporating instruction tuning and multimodal capabilities,…

Computation and Language · Computer Science 2023-08-04 Ziao Wang , Yuhang Li , Junda Wu , Jaehyeon Soon , Xiaofeng Zhang

Large language models (LLMs) have demonstrated great potential in natural language processing tasks within the financial domain. In this work, we present a Chinese Financial Generative Pre-trained Transformer framework, named CFGPT, which…

Computation and Language · Computer Science 2023-09-25 Jiangtong Li , Yuxuan Bian , Guoxuan Wang , Yang Lei , Dawei Cheng , Zhijun Ding , Changjun Jiang

Large Language Models (LLMs), such as ChatGPT, LLaMA, GLM, and PaLM, have exhibited remarkable performances across various tasks in recent years. However, LLMs face two main challenges in real-world applications. One challenge is that…

Machine Learning · Computer Science 2023-10-17 Tao Fan , Yan Kang , Guoqiang Ma , Weijing Chen , Wenbin Wei , Lixin Fan , Qiang Yang

Previous studies on federated learning (FL) often encounter performance degradation due to data heterogeneity among different clients. In light of the recent advances in multimodal large language models (MLLMs), such as GPT-4v and LLaVA,…

Artificial Intelligence · Computer Science 2024-12-03 Jianyi Zhang , Hao Frank Yang , Ang Li , Xin Guo , Pu Wang , Haiming Wang , Yiran Chen , Hai Li

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

The rise of foundation models has transformed machine learning research, prompting efforts to uncover their inner workings and develop more efficient and reliable applications for better control. While significant progress has been made in…

The emergence of Large Language Models (LLMs), such as ChatGPT, has revolutionized general natural language preprocessing (NLP) tasks. However, their expertise in the financial domain lacks a comprehensive evaluation. To assess the ability…

Computation and Language · Computer Science 2023-10-20 Yue Guo , Zian Xu , Yi Yang

In the past year, Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in tasks such as visual question answering, visual understanding and reasoning. However, the extensive model size and high training and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yizhang Jin , Jian Li , Yexin Liu , Tianjun Gu , Kai Wu , Zhengkai Jiang , Muyang He , Bo Zhao , Xin Tan , Zhenye Gan , Yabiao Wang , Chengjie Wang , Lizhuang Ma

With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive the real world, make decisions, and control tools as humans.…

Large Language Models (LLMs) have demonstrated impressive success across various tasks. Integrating LLMs with Federated Learning (FL), a paradigm known as FedLLM, offers a promising avenue for collaborative model adaptation while preserving…

Machine Learning · Computer Science 2026-02-25 Yebo Wu , Chunlin Tian , Jingguang Li , He Sun , Kahou Tam , Zhanting Zhou , Haicheng Liao , Jing Xiong , Zhijiang Guo , Li Li , Chengzhong Xu