English
Related papers

Related papers: Multimodal Financial Foundation Models (MFFMs): Pr…

200 papers

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Multimodal search has become increasingly important in providing users with a natural and effective way to ex-press their search intentions. Images offer fine-grained details of the desired products, while text allows for easily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Oriol Barbany , Michael Huang , Xinliang Zhu , Arnab Dhua

The integration of Foundation Models (FMs) with Federated Learning (FL) presents a transformative paradigm in Artificial Intelligence (AI). This integration offers enhanced capabilities, while addressing concerns of privacy, data…

Machine Learning · Computer Science 2024-09-10 Chao Ren , Han Yu , Hongyi Peng , Xiaoli Tang , Bo Zhao , Liping Yi , Alysa Ziying Tan , Yulan Gao , Anran Li , Xiaoxiao Li , Zengxiang Li , Qiang Yang

The development of Large Language Models (LLMs) has created transformative opportunities for the financial industry, especially in the area of financial trading. However, how to integrate LLMs with trading systems has become a challenge. To…

Computational Engineering, Finance, and Science · Computer Science 2024-12-09 Yu Kang , Ge Wang , Xin Yang , Yuda Wang , Mingwen Liu

Recent advances in Generative Artificial Intelligence, particularly Large Language Models (LLMs), have stimulated growing interest in automating or assisting Business Process Modeling tasks using natural language. Several approaches have…

Software Engineering · Computer Science 2026-04-16 João Bettencourt , Sérgio Guerreiro

We present MaterialFigBench, a benchmark dataset designed to evaluate the ability of multimodal large language models (LLMs) to solve university-level materials science problems that require accurate interpretation of figures. Unlike…

Computation and Language · Computer Science 2026-03-13 Michiko Yoshitake , Yuta Suzuki , Ryo Igarashi , Yoshitaka Ushiku , Keisuke Nagato

The recent emergence of large language models (LLMs) such as GPT-3 has marked a significant paradigm shift in machine learning. Trained on massive corpora of data, these models demonstrate remarkable capabilities in language understanding,…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Seyyedali Hosseinalipour , Shimiao Li , Adedoyin Inaolaji , Filippo Malandra , Luis Herrera , Nicholas Mastronarde

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such as ChatGPT, LLaMa,…

Machine Learning · Computer Science 2024-05-14 Xingyu Li , Lu Peng , Yuping Wang , Weihua Zhang

Recent advancements in self-improvement for Large Language Models (LLMs) have efficiently enhanced model capabilities without significantly increasing costs, particularly in terms of human effort. While this area is still relatively young,…

Computation and Language · Computer Science 2025-10-06 Shijian Deng , Kai Wang , Tianyu Yang , Harsh Singh , Yapeng Tian

Recent advances in large language models (LLMs) have enabled multi-agent reasoning systems capable of collaborative decision-making. However, in financial analysis, most frameworks remain narrowly focused on either isolated single-agent…

Computational Engineering, Finance, and Science · Computer Science 2025-10-28 Chen-Che Lu , Yun-Cheng Chou , Teng-Ruei Chen

Multilingual Large Language Models are capable of using powerful Large Language Models to handle and respond to queries in multiple languages, which achieves remarkable success in multilingual natural language processing tasks. Despite…

Computation and Language · Computer Science 2024-04-09 Libo Qin , Qiguang Chen , Yuhang Zhou , Zhi Chen , Yinghui Li , Lizi Liao , Min Li , Wanxiang Che , Philip S. Yu

The ChatGPT, a lite and conversational variant of Generative Pretrained Transformer 4 (GPT-4) developed by OpenAI, is one of the milestone Large Language Models (LLMs) with billions of parameters. LLMs have stirred up much interest among…

Computation and Language · Computer Science 2023-08-01 Hanyao Huang , Ou Zheng , Dongdong Wang , Jiayi Yin , Zijin Wang , Shengxuan Ding , Heng Yin , Chuan Xu , Renjie Yang , Qian Zheng , Bing Shi

Strong Artificial Intelligence (Strong AI) or Artificial General Intelligence (AGI) with abstract reasoning ability is the goal of next-generation AI. Recent advancements in Large Language Models (LLMs), along with the emerging field of…

Computation and Language · Computer Science 2024-01-19 Yiqi Wang , Wentao Chen , Xiaotian Han , Xudong Lin , Haiteng Zhao , Yongfei Liu , Bohan Zhai , Jianbo Yuan , Quanzeng You , Hongxia Yang

Multimodal large language models (MLLMs) have emerged as a promising paradigm for dental image analysis. However, their ability to capture the multi-level cognitive processes required for radiographic analysis remains unclear. Here, we…

Computation and Language · Computer Science 2026-05-11 Rongyang Wang , Shuang Zhou , Jiashuo Wang , Wenya Xie , Xiaoxia Che

Large language models (LLMs) have demonstrated remarkable potential in handling multilingual machine translation (MMT). In this paper, we systematically investigate the advantages and challenges of LLMs for MMT by answering two questions:…

Computation and Language · Computer Science 2024-06-17 Wenhao Zhu , Hongyi Liu , Qingxiu Dong , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li

Large Language Models (LLMs) have stunningly advanced the field of machine translation, though their effectiveness within the financial domain remains largely underexplored. To probe this issue, we constructed a fine-grained Chinese-English…

Computation and Language · Computer Science 2024-06-28 Yuxin Fu , Shijing Si , Leyi Mai , Xi-ang Li

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

Machine Translation (MT) has greatly advanced over the years due to the developments in deep neural networks. However, the emergence of Large Language Models (LLMs) like GPT-4 and ChatGPT is introducing a new phase in the MT domain. In this…

Computation and Language · Computer Science 2024-04-03 Chenyang Lyu , Zefeng Du , Jitao Xu , Yitao Duan , Minghao Wu , Teresa Lynn , Alham Fikri Aji , Derek F. Wong , Siyou Liu , Longyue Wang

Recent breakthroughs in large language models (LLMs) have led to the development of new benchmarks for evaluating their performance in the financial domain. However, current financial benchmarks often rely on news articles, earnings…

Computation and Language · Computer Science 2025-08-19 Jie Zhu , Junhui Li , Yalong Wen , Xiandong Li , Lifan Guo , Feng Chen

Large language models (LLMs) are deep learning algorithms being used to perform natural language processing tasks in various fields, from social sciences to finance and biomedical sciences. Developing and training a new LLM can be very…

General Finance · Quantitative Finance 2024-01-23 Valentina Aparicio , Daniel Gordon , Sebastian G. Huayamares , Yuhuai Luo