中文
相关论文

相关论文: FinVis-GPT: A Multimodal Large Language Model for …

200 篇论文

Do current large language models (LLMs) better solve graph reasoning and generation tasks with parameter updates? In this paper, we propose InstructGraph, a framework that empowers LLMs with the abilities of graph reasoning and generation…

计算与语言 · 计算机科学 2024-02-15 Jianing Wang , Junda Wu , Yupeng Hou , Yao Liu , Ming Gao , Julian McAuley

Multimodal large language models (MLLMs) are designed to process and integrate information from multiple sources, such as text, speech, images, and videos. Despite its success in language understanding, it is critical to evaluate the…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Hao Lu , Xuesong Niu , Jiyao Wang , Yin Wang , Qingyong Hu , Jiaqi Tang , Yuting Zhang , Kaishen Yuan , Bin Huang , Zitong Yu , Dengbo He , Shuiguang Deng , Hao Chen , Yingcong Chen , Shiguang Shan

While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored. Particularly, using LLMs for complex reasoning tasks on…

计算与语言 · 计算机科学 2023-10-18 Jiho Kim , Yeonsu Kwon , Yohan Jo , Edward Choi

Conversation agents fueled by Large Language Models (LLMs) are providing a new way to interact with visual data. While there have been initial attempts for image-based conversation models, this work addresses the under-explored field of…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Shahbaz Khan

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

机器学习 · 计算机科学 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Advancements in Large Language Models (LLMs) have significantly enhanced instruction-following capabilities. However, most Instruction Fine-Tuning (IFT) datasets are predominantly in English, limiting model performance in other languages.…

Charts are a fundamental visualization format widely used in data analysis across research and industry. While enabling users to edit charts based on high-level intentions is of great practical value, existing methods primarily rely on…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Donglu Yang , Liang Zhang , Zihao Yue , Liangyu Chen , Yichen Xu , Wenxuan Wang , Qin Jin

The rapid development of large language models (LLM) has greatly enhanced everyday applications. While many FPGA-based accelerators, with flexibility for fine-grained data control, exhibit superior speed and energy efficiency compared to…

硬件体系结构 · 计算机科学 2026-03-24 Zifan He , Shengyu Ye , Rui Ma , Yang Wang , Jason Cong

Financial report generation tasks range from macro- to micro-economics analysis, also requiring extensive data analysis. Existing LLM models are usually fine-tuned on simple QA tasks and cannot comprehensively analyze real financial…

计算工程、金融与科学 · 计算机科学 2025-07-15 Yingqian Wu , Qiushi Wang , Zefei Long , Rong Ye , Zhongtian Lu , Xianyin Zhang , Bingxuan Li , Wei Chen , Liwen Zhang , Zhongyu Wei

Text-rich graphs, which exhibit rich textual information on nodes and edges, are prevalent across a wide range of real-world business applications. Large Language Models (LLMs) have demonstrated remarkable abilities in understanding text,…

计算与语言 · 计算机科学 2024-04-30 Qi Zhu , Da Zheng , Xiang Song , Shichang Zhang , Bowen Jin , Yizhou Sun , George Karypis

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

We introduce FinanceMath, a novel benchmark designed to evaluate LLMs' capabilities in solving knowledge-intensive math reasoning problems. Compared to prior works, this study features three core advancements. First, FinanceMath includes…

计算与语言 · 计算机科学 2024-08-09 Yilun Zhao , Hongjun Liu , Yitao Long , Rui Zhang , Chen Zhao , Arman Cohan

Current multimodal large language models (MLLMs), while effective in natural image understanding, struggle with visualization understanding due to their inability to decode the data-to-visual mapping and extract structured information. To…

人机交互 · 计算机科学 2025-07-03 Can Liu , Chunlin Da , Xiaoxiao Long , Yuxiao Yang , Yu Zhang , Yong Wang

Recent methods for customizing Large Vision Language Models (LVLMs) for domain-specific tasks have shown promising results in scientific chart comprehension. However, existing approaches face two major limitations: First, they rely on…

计算与语言 · 计算机科学 2025-07-22 Wan-Cyuan Fan , Yen-Chun Chen , Mengchen Liu , Alexander Jacobson , Lu Yuan , Leonid Sigal

Charts provide visual representations of data and are widely used for analyzing information, addressing queries, and conveying insights to others. Various chart-related downstream tasks have emerged recently, such as question-answering and…

计算与语言 · 计算机科学 2024-03-15 Ahmed Masry , Mehrad Shahmohammadi , Md Rizwan Parvez , Enamul Hoque , Shafiq Joty

Trading range breakout is a key method in the technical analysis of financial trading, widely employed by traders in financial markets such as stocks, futures, and foreign exchange. However, distinguishing between true and false breakout…

人工智能 · 计算机科学 2025-02-25 Kang Zhang , Osamu Yoshie , Lichao Sun , Weiran Huang

Recent advancements in Large Language Models (LLMs) have exhibited notable efficacy in question-answering (QA) tasks across diverse domains. Their prowess in integrating extensive web knowledge has fueled interest in developing LLM-based…

This paper aims to efficiently enable Large Language Models (LLMs) to use multimodal tools. Advanced proprietary LLMs, such as ChatGPT and GPT-4, have shown great potential for tool usage through sophisticated prompt engineering.…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Rui Yang , Lin Song , Yanwei Li , Sijie Zhao , Yixiao Ge , Xiu Li , Ying Shan

In the modern financial sector, the exponential growth of data has made efficient and accurate financial data analysis increasingly crucial. Traditional methods, such as statistical analysis and rule-based systems, often struggle to process…

统计金融 · 定量金融 2025-04-10 Jingru Wang , Wen Ding , Xiaotong Zhu

Generative AI, particularly large language models (LLMs), is beginning to transform the financial industry by automating tasks and helping to make sense of complex financial information. One especially promising use case is the automatic…

统计金融 · 定量金融 2025-11-11 Zonghan Wu , Congyuan Zou , Junlin Wang , Chenhan Wang , Hangjing Yang , Yilei Shao