English
Related papers

Related papers: BALM-TSF: Balanced Multimodal Alignment for LLM-Ba…

200 papers

Time-Series Foundation Models (TSFMs) excel at zero-shot unimodal forecasting using numerical data, but unlike LLMs they cannot consume multimodal, non-numerical context that often shape real-world trajectories. In this work, we bridge this…

Machine Learning · Computer Science 2026-05-29 Haoxin Liu , Yichen Zhou , Rajat Sen , B. Aditya Prakash , Abhimanyu Das

While LLMs have demonstrated remarkable potential in time series forecasting, their practical deployment remains constrained by excessive computational demands and memory footprints. Existing LLM-based approaches typically suffer from three…

Computation and Language · Computer Science 2025-03-11 Haoran Fan , Bin Li , Yixuan Weng , Shoujun Zhou

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

Computation and Language · Computer Science 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities…

Machine Learning · Computer Science 2026-02-06 Jiecheng Lu , Yan Sun , Shihao Yang

Conventional forecasting methods rely on unimodal time series data, limiting their ability to exploit rich textual information. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demonstrated powerful…

Machine Learning · Computer Science 2025-05-16 Chengsen Wang , Qi Qi , Zhongwen Rao , Lujia Pan , Jingyu Wang , Jianxin Liao

Recent studies in time series forecasting (TSF) use multimodal inputs, such as text and historical time series data, to predict future values. These studies mainly focus on developing advanced techniques to integrate textual information…

Computation and Language · Computer Science 2025-09-03 Chen Su , Yuanhe Tian , Yan Song , Yongdong Zhang

Diffusion models achieve remarkable success in processing images and text, and have been extended to special domains such as time series forecasting (TSF). Existing diffusion-based approaches for TSF primarily focus on modeling…

Computation and Language · Computer Science 2025-04-29 Chen Su , Yuanhe Tian , Yan Song

Time series forecasting plays a critical role in decision-making across many real-world applications. Unlike data in vision and language domains, time series data is inherently tied to the evolution of underlying processes and can only…

Machine Learning · Computer Science 2026-02-03 Suhan Guo , Bingxu Wang , Shaodan Zhang , Furao Shen

With the success of pre-trained language models (PLMs) in various application fields beyond natural language processing, language models have raised emerging attention in the field of time series forecasting (TSF) and have shown great…

Machine Learning · Computer Science 2025-09-30 Peng Chen , Yihang Wang , Yang Shu , Yunyao Cheng , Kai Zhao , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using…

Machine Learning · Computer Science 2026-01-14 Jiacheng You , Jingcheng Yang , Yuhang Xie , Zhongxuan Wu , Xiucheng Li , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xinyang Chen

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

In the time-series domain, an increasing number of works combine text with temporal data to leverage the reasoning capabilities of large language models (LLMs) for various downstream time-series understanding tasks. This enables a single…

Computation and Language · Computer Science 2025-11-11 Zhirui Zhang , Changhua Pei , Tianyi Gao , Zhe Xie , Yibo Hao , Zhaoyang Yu , Longlong Xu , Tong Xiao , Jing Han , Dan Pei

The emerging paradigm of leveraging pretrained large language models (LLMs) for time series forecasting has predominantly employed linguistic-temporal modality alignment strategies through token-level or layer-wise feature mapping. However,…

Artificial Intelligence · Computer Science 2025-05-20 Siming Sun , Kai Zhang , Xuejun Jiang , Wenchao Meng , Qinmin Yang

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Time Series Foundation Models (TSFMs) excel at numerical forecasting but operate as black boxes lacking qualitative reasoning. Conversely, applying LLMs directly to temporal data introduces a modality gap: text tokenizers fragment…

Machine Learning · Computer Science 2026-05-12 Md Atik Ahamed , Mihir Parmar , Palash Goyal , Chun-Liang Li , Qiang Cheng , Tomas Pfister , Jinsung Yoon

Large Language Models (LLMs) have demonstrated impressive performance in time series analysis and seems to understand the time temporal relationship well than traditional transformer-based approaches. However, since LLMs are not designed…

Machine Learning · Computer Science 2025-05-27 Liangwei Nathan Zheng , Chang George Dong , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Text and time series data offer complementary views of financial markets: news articles provide narrative context about company events, while stock prices reflect how markets react to those events. However, despite their complementary…

Computational Engineering, Finance, and Science · Computer Science 2025-09-25 Ross Koval , Nicholas Andrews , Xifeng Yan

Large language models are being rapidly deployed across many fields such as healthcare, finance, transportation, and energy, where time-series data are fundamental components. The current works are still limited in their ability to perform…

Artificial Intelligence · Computer Science 2026-01-23 Paul Quinlan , Qingguo Li , Xiaodan Zhu

Recent research has shown that large language models (LLMs) can be effectively used for real-world time series forecasting due to their strong natural language understanding capabilities. However, aligning time series into semantic spaces…

Machine Learning · Computer Science 2024-12-03 Lingzheng Zhang , Lifeng Shen , Yimin Zheng , Shiyuan Piao , Ziyue Li , Fugee Tsung