English
Related papers

Related papers: Using Pre-trained LLMs for Multivariate Time Serie…

200 papers

Using pre-trained large language models (LLMs) as a backbone for time series prediction has recently attracted growing research interest. Existing approaches typically split time series into patches, map them to the token space of LLMs via…

Machine Learning · Computer Science 2026-03-09 Xinyu Zhang , Shanshan Feng , Xutao Li , Kenghong Lin , Fan Li , Pengfei Jia

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

With the widespread adoption of Large Language Models (LLMs), there is a growing need to establish best practices for leveraging their capabilities beyond traditional natural language tasks. In this paper, a novel cross-domain knowledge…

Machine Learning · Computer Science 2025-09-29 Mohammadmahdi Ghasemloo , Alireza Moradi

Time series forecasting plays a significant role in finance, energy, meteorology, and IoT applications. Recent studies have leveraged the generalization capabilities of large language models (LLMs) to adapt to time series forecasting,…

Machine Learning · Computer Science 2026-05-12 Hao Liu , Xiaoxing Zhang , Chun Yang , Xiaobin Zhu

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

Time series data is fundamental to decision-making across many domains including healthcare, finance, power systems, and logistics. However, analyzing this data correctly often requires incorporating unstructured contextual information,…

Machine Learning · Computer Science 2026-03-17 Felix Parker , Nimeesha Chan , Chi Zhang , Kimia Ghobadi

Large language models (LLMs) have been introduced to time series forecasting (TSF) to incorporate contextual knowledge beyond numerical signals. However, existing studies question whether LLMs provide genuine benefits, often reporting…

Computation and Language · Computer Science 2026-03-04 Xin Qiu , Junlong Tong , Yirong Sun , Yunpu Ma , Wei Zhang , Xiaoyu Shen

Time series analysis is pivotal in domains like financial forecasting and biomedical monitoring, yet traditional methods are constrained by limited nonlinear feature representation and long-term dependency capture. The emergence of Large…

Machine Learning · Computer Science 2025-06-16 Feifei Shi , Xueyan Yin , Kang Wang , Wanyu Tu , Qifu Sun , Huansheng Ning

Multi-modal large language models (MLLMs) have enabled numerous advances in understanding and reasoning in domains like vision, but we have not yet seen this broad success for time-series. Although prior works on time-series MLLMs have…

Machine Learning · Computer Science 2024-12-05 Winnie Chow , Lauren Gardiner , Haraldur T. Hallgrímsson , Maxwell A. Xu , Shirley You Ren

Fine-tuning pre-trained large language models (LLMs) on a diverse array of tasks has become a common approach for building models that can solve various natural language processing (NLP) tasks. However, where and to what extent these models…

Computation and Language · Computer Science 2024-10-29 Zheng Zhao , Yftah Ziser , Shay B. Cohen

Can language-pretrained transformers become effective time-series forecasters, and why? In this paper, we show that cross-modal transfer arises because language pretraining preconditions time series training with a reusable manifold. A…

Machine Learning · Computer Science 2026-05-21 Alexis Roger , Prateek Humane , Zhenghan Tai , Gwen Legate , Andrei Mircea , Vasilii Feofanov , Irina Rish

Large Language Models (LLMs) offer the potential for automatic time series analysis and reporting, which is a critical task across many domains, spanning healthcare, finance, climate, energy, and many more. In this paper, we propose a…

Computation and Language · Computer Science 2024-10-10 Elizabeth Fons , Rachneet Kaur , Soham Palande , Zhen Zeng , Tucker Balch , Manuela Veloso , Svitlana Vyetrenko

This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and…

Machine Learning · Computer Science 2024-08-12 Rui Cao , Qiao Wang

Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years. As a classic machine learning task, time series forecasting has recently been boosted by LLMs. Recent works treat large language…

Computation and Language · Computer Science 2024-12-31 Hua Tang , Chong Zhang , Mingyu Jin , Qinkai Yu , Zhenting Wang , Xiaobo Jin , Yongfeng Zhang , Mengnan Du

Model selection is a critical step in time series forecasting, traditionally requiring extensive performance evaluations across various datasets. Meta-learning approaches aim to automate this process, but they typically depend on…

Machine Learning · Computer Science 2025-04-04 Wang Wei , Tiankai Yang , Hongjie Chen , Ryan A. Rossi , Yue Zhao , Franck Dernoncourt , Hoda Eldardiry

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Large Language Models (LLMs) have been extensively applied in time series analysis. Yet, their utility in the few-shot classification (i.e., a crucial training scenario due to the limited training data available in industrial applications)…

Machine Learning · Computer Science 2025-02-04 Yakun Chen , Zihao Li , Chao Yang , Xianzhi Wang , Guandong Xu

Recent works have demonstrated the effectiveness of adapting pre-trained language models (LMs) for forecasting time series in the low-data regime. We build upon these findings by analyzing the effective transfer from language models to time…

Computation and Language · Computer Science 2025-06-30 Roland Riachi , Kashif Rasul , Arjun Ashok , Prateek Humane , Alexis Roger , Andrew R. Williams , Yuriy Nevmyvaka , Irina Rish

Time series analysis has witnessed the inspiring development from traditional autoregressive models, deep learning models, to recent Transformers and Large Language Models (LLMs). Efforts in leveraging vision models for time series analysis…

Machine Learning · Computer Science 2025-09-03 Jingchao Ni , Ziming Zhao , ChengAo Shen , Hanghang Tong , Dongjin Song , Wei Cheng , Dongsheng Luo , Haifeng Chen

Time series data plays a critical role across diverse domains such as healthcare, energy, and finance, where tasks like classification, anomaly detection, and forecasting are essential for informed decision-making. Recently, large language…

Machine Learning · Computer Science 2024-12-18 Francis Tang , Ying Ding