English
Related papers

Related papers: FinVis-GPT: A Multimodal Large Language Model for …

200 papers

Financial large language models (FinLLMs) have been applied to various tasks in business, finance, accounting, and auditing. Complex financial regulations and standards are critical to financial services, which LLMs must comply with.…

Computational Engineering, Finance, and Science · Computer Science 2025-01-14 Keyi Wang , Jaisal Patel , Charlie Shen , Daniel Kim , Andy Zhu , Alex Lin , Luca Borella , Cailean Osborne , Matt White , Steve Yang , Kairong Xiao , Xiao-Yang Liu Yanglet

We introduce and make publicly available the NIFTY Financial News Headlines dataset, designed to facilitate and advance research in financial market forecasting using large language models (LLMs). This dataset comprises two distinct…

Computational Finance · Quantitative Finance 2024-05-17 Raeid Saqur , Ken Kato , Nicholas Vinden , Frank Rudzicz

The remote sensing image intelligence understanding model is undergoing a new profound paradigm shift which has been promoted by multi-modal large language model (MLLM), i.e. from the paradigm learning a domain model (LaDM) shifts to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Linrui Xu , Ling Zhao , Wang Guo , Qiujun Li , Kewang Long , Kaiqi Zou , Yuhan Wang , Haifeng Li

The success of large language models (LLMs) has inspired an emerging research field of multimodal learning. However, a grand challenge of exploiting LLMs for multimodal learning is the size of pre-trained LLMs which are always with billions…

Computation and Language · Computer Science 2024-04-08 Zhengqing Yuan , Yunhong He , Kun Wang , Yanfang Ye , Lichao Sun

Large Language Models (LLMs) have been widely used in various tasks, motivating us to develop an LLM-based assistant for videos. Instead of training from scratch, we propose a module to transform arbitrary well-trained image-based LLMs into…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Lishuai Gao , Yujie Zhong , Yingsen Zeng , Haoxian Tan , Dengjie Li , Zheng Zhao

Financial sentiment analysis is critical for valuation and investment decision-making. Traditional NLP models, however, are limited by their parameter size and the scope of their training datasets, which hampers their generalization…

Computation and Language · Computer Science 2023-11-07 Boyu Zhang , Hongyang Yang , Tianyu Zhou , Ali Babar , Xiao-Yang Liu

Graphs are an essential data structure utilized to represent relationships in real-world scenarios. Prior research has established that Graph Neural Networks (GNNs) deliver impressive outcomes in graph-centric tasks, such as link prediction…

Machine Learning · Computer Science 2024-09-12 Xubin Ren , Jiabin Tang , Dawei Yin , Nitesh Chawla , Chao Huang

Traditional banks face increasing competition from FinTechs in the rapidly evolving financial ecosystem. Raising operational efficiency is vital to address this challenge. Our study aims to improve the efficiency of document-intensive…

Computation and Language · Computer Science 2023-11-28 Christopher Gerling , Stefan Lessmann

This paper explores the potential of large language models (LLMs) to generate financial reports from time series data. We propose a framework encompassing prompt engineering, model selection, and evaluation. We introduce an automated…

Computation and Language · Computer Science 2025-07-02 Elizabeth Fons , Elena Kochkina , Rachneet Kaur , Zhen Zeng , Berowne Hlavaty , Charese Smiley , Svitlana Vyetrenko , Manuela Veloso

In recent years, multimodal benchmarks for general domains have guided the rapid development of multimodal models on general tasks. However, the financial field has its peculiarities. It features unique graphical images (e.g., candlestick…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Ziliang Gan , Yu Lu , Dong Zhang , Haohan Li , Che Liu , Jian Liu , Ji Liu , Haipang Wu , Chaoyou Fu , Zenglin Xu , Rongjunchen Zhang , Yong Dai

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

Graph mining is an important area in data mining and machine learning that involves extracting valuable information from graph-structured data. In recent years, significant progress has been made in this field through the development of…

Machine Learning · Computer Science 2024-12-30 Yuxin You , Zhen Liu , Xiangchao Wen , Yongtao Zhang , Wei Ai

Large Language Models (LLMs) are increasingly adopted in financial analysis for interpreting complex market data and trends. However, their use is challenged by intrinsic biases (e.g., risk-preference bias) and a superficial understanding…

Computation and Language · Computer Science 2024-07-02 Yuhang Zhou , Yuchen Ni , Yunhui Gan , Zhangyue Yin , Xiang Liu , Jian Zhang , Sen Liu , Xipeng Qiu , Guangnan Ye , Hongfeng Chai

FPGAs are increasingly adopted in datacenter environments for their reconfigurability and energy efficiency. High-Level Synthesis (HLS) tools have eased FPGA programming by raising the abstraction level from RTL to untimed C/C++, yet…

Machine Learning · Computer Science 2025-05-01 Neha Prakriya , Zijian Ding , Yizhou Sun , Jason Cong

Instruction tuning is a crucial supervised training phase in Large Language Models (LLMs), aiming to enhance the LLM's ability to generalize instruction execution and adapt to user preferences. With the increasing integration of multi-modal…

Multimedia · Computer Science 2023-11-28 Chen Li , Yixiao Ge , Dian Li , Ying Shan

Large language models (LLMs) have demonstrated a powerful ability to answer various queries as a general-purpose assistant. The continuous multi-modal large language models (MLLM) empower LLMs with the ability to perceive visual signals.…

Computation and Language · Computer Science 2024-01-05 Ziqiang Zheng , Yiwei Chen , Jipeng Zhang , Tuan-Anh Vu , Huimin Zeng , Yue Him Wong Tim , Sai-Kit Yeung

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in representing and understanding diverse modalities. However, they typically focus on modality alignment in a pairwise manner while overlooking structural…

Machine Learning · Computer Science 2025-06-13 Jiajin Liu , Dongzhe Fan , Jiacheng Shen , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Graph Databases (Graph DB) find extensive application across diverse domains such as finance, social networks, and medicine. Yet, the translation of Natural Language (NL) into the Graph Query Language (GQL), referred to as NL2GQL, poses…

Computation and Language · Computer Science 2024-09-06 Yuanyuan Liang , Keren Tan , Tingyu Xie , Wenbiao Tao , Siyuan Wang , Yunshi Lan , Weining Qian

Financial trading has been a challenging task, as it requires the integration of vast amounts of data from various modalities. Traditional deep learning and reinforcement learning methods require large training data and often involve…

Trading and Market Microstructure · Quantitative Finance 2024-11-15 Sorouralsadat Fatemi , Yuheng Hu