中文
相关论文

相关论文: MLLM4TS: Leveraging Vision and Multimodal Language…

200 篇论文

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

机器学习 · 计算机科学 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

Multi-modal large language models (MLLMs) have enabled numerous advances in understanding and reasoning in domains like vision, but we have not yet seen this broad success for time-series. Although prior works on time-series MLLMs have…

机器学习 · 计算机科学 2024-12-05 Winnie Chow , Lauren Gardiner , Haraldur T. Hallgrímsson , Maxwell A. Xu , Shirley You Ren

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

人工智能 · 计算机科学 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Large language models are being rapidly deployed across many fields such as healthcare, finance, transportation, and energy, where time-series data are fundamental components. The current works are still limited in their ability to perform…

人工智能 · 计算机科学 2026-01-23 Paul Quinlan , Qingguo Li , Xiaodan Zhu

Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time…

机器学习 · 计算机科学 2025-07-02 Sixun Dong , Wei Fan , Teresa Wu , Yanjie Fu

Large language models (LLMs) have shown remarkable performance in vision-language tasks, but their application in the medical field remains underexplored, particularly for integrating structured time series data with unstructured clinical…

计算与语言 · 计算机科学 2025-06-17 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Wei Bi , Yida Xu , Guo Li , Xian Yang

We build upon time-series classification by leveraging the capabilities of Vision Language Models (VLMs). We find that VLMs produce competitive results after two or less epochs of fine-tuning. We develop a novel approach that incorporates…

人工智能 · 计算机科学 2025-01-22 Vinay Prithyani , Mohsin Mohammed , Richa Gadgil , Ricardo Buitrago , Vinija Jain , Aman Chadha

Advances in multi-modal large language models (MLLMs) have inspired time series understanding and reasoning tasks, that enable natural language querying over time series, producing textual analyses of complex temporal dynamics. Recent…

机器学习 · 计算机科学 2026-02-05 Hang Ni , Weijia Zhang , Fei Wang , Zezhi Shao , Hao Liu

Multimodal Large Language Models (MLLMs) have achieved significant advancements in tasks like Visual Question Answering (VQA) by leveraging foundational Large Language Models (LLMs). However, their abilities in specific areas such as visual…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Mohamed Fazli Imam , Chenyang Lyu , Alham Fikri Aji

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel…

机器学习 · 计算机科学 2025-03-12 Shule Hao , Junpeng Bao , Chuncheng Lu

Large language models (LLMs) have been introduced to time series forecasting (TSF) to incorporate contextual knowledge beyond numerical signals. However, existing studies question whether LLMs provide genuine benefits, often reporting…

计算与语言 · 计算机科学 2026-03-04 Xin Qiu , Junlong Tong , Yirong Sun , Yunpu Ma , Wei Zhang , Xiaoyu Shen

The adaptation of large language models (LLMs) to time series forecasting poses unique challenges, as time series data is continuous in nature, while LLMs operate on discrete tokens. Despite the success of LLMs in natural language…

计算与语言 · 计算机科学 2025-08-05 Taibiao Zhao , Xiaobing Chen , Mingxuan Sun

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

人工智能 · 计算机科学 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Recent research has shown that large language models (LLMs) can be effectively used for real-world time series forecasting due to their strong natural language understanding capabilities. However, aligning time series into semantic spaces…

机器学习 · 计算机科学 2024-12-03 Lingzheng Zhang , Lifeng Shen , Yimin Zheng , Shiyuan Piao , Ziyue Li , Fugee Tsung

Large Language Models (LLMs) have demonstrated impressive performance in time series analysis and seems to understand the time temporal relationship well than traditional transformer-based approaches. However, since LLMs are not designed…

机器学习 · 计算机科学 2025-05-27 Liangwei Nathan Zheng , Chang George Dong , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Large Language Models (LLMs) offer the potential for automatic time series analysis and reporting, which is a critical task across many domains, spanning healthcare, finance, climate, energy, and many more. In this paper, we propose a…

计算与语言 · 计算机科学 2024-10-10 Elizabeth Fons , Rachneet Kaur , Soham Palande , Zhen Zeng , Tucker Balch , Manuela Veloso , Svitlana Vyetrenko

We explore Multimodal Large Language Models (MLLMs), which integrate LLMs like GPT-4 to handle multimodal data, including text, images, audio, and more. MLLMs demonstrate capabilities such as generating image captions and answering…

计算与语言 · 计算机科学 2025-01-09 Shezheng Song , Xiaopeng Li , Shasha Li , Shan Zhao , Jie Yu , Jun Ma , Xiaoguang Mao , Weimin Zhang

In an era defined by the explosive growth of data and rapid technological advancements, Multimodal Large Language Models (MLLMs) stand at the forefront of artificial intelligence (AI) systems. Designed to seamlessly integrate diverse data…

Power system time series analytics is critical in understanding the system operation conditions and predicting the future trends. Despite the wide adoption of Artificial Intelligence (AI) tools, many AI-based time series analytical models…

信号处理 · 电气工程与系统科学 2025-11-12 Zhenghao Zhou , Yiyan Li , Xinjie Yu , Runlong Liu , Zelin Guo , Zheng Yan , Mo-Yuen Chow , Yuqi Yang , Yang Xu