English
Related papers

Related papers: T-LLM: Teaching Large Language Models to Forecast …

200 papers

The adaptation of large language models (LLMs) to time series forecasting poses unique challenges, as time series data is continuous in nature, while LLMs operate on discrete tokens. Despite the success of LLMs in natural language…

Computation and Language · Computer Science 2025-08-05 Taibiao Zhao , Xiaobing Chen , Mingxuan Sun

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

With the evolution of large language models (LLMs), there is growing interest in leveraging LLMs for time series tasks. In this paper, we explore the characteristics of LLMs for time series forecasting by considering various existing and…

Machine Learning · Computer Science 2025-02-11 Janghoon Yang

Self-supervised methods have gained prominence in time series anomaly detection due to the scarcity of available annotations. Nevertheless, they typically demand extensive training data to acquire a generalizable representation map, which…

Machine Learning · Computer Science 2024-01-30 Chen Liu , Shibo He , Qihang Zhou , Shizhong Li , Wenchao Meng

Knowledge distillation has proven effective for model compression by transferring knowledge from a larger network called the teacher to a smaller network called the student. Current knowledge distillation in time series is predominantly…

Machine Learning · Computer Science 2026-01-12 Nilushika Udayangani Hewa Dehigahawattage , Kishor Nandakishor , Marimuthu Palaniswami

Time Series Forecasting (TSF) has long been a challenge in time series analysis. Inspired by the success of Large Language Models (LLMs), researchers are now developing Large Time Series Models (LTSMs)-universal transformer-based models…

With the success of pre-trained language models (PLMs) in various application fields beyond natural language processing, language models have raised emerging attention in the field of time series forecasting (TSF) and have shown great…

Machine Learning · Computer Science 2025-09-30 Peng Chen , Yihang Wang , Yang Shu , Yunyao Cheng , Kai Zhao , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Accurate traffic flow prediction is vital for optimizing urban mobility, yet it remains difficult in many cities due to complex spatio-temporal dependencies and limited high-quality data. While deep graph-based models demonstrate strong…

Machine Learning · Computer Science 2025-04-04 Chenyang Yu , Xinpeng Xie , Yan Huang , Chenxi Qiu

Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time…

Machine Learning · Computer Science 2025-07-02 Sixun Dong , Wei Fan , Teresa Wu , Yanjie Fu

Large language models (LLMs) are often trained on extensive, temporally indiscriminate text corpora, reflecting the lack of datasets with temporal metadata. This approach is not aligned with the evolving nature of language. Conventional…

Computation and Language · Computer Science 2024-04-30 Felix Drinkall , Eghbal Rahimikia , Janet B. Pierrehumbert , Stefan Zohren

Large Language Models (LLMs) have demonstrated effectiveness as zero-shot time series (TS) forecasters. The key challenge lies in tokenizing TS data into textual representations that align with LLMs' pre-trained knowledge. While existing…

Artificial Intelligence · Computer Science 2025-12-24 Xingyou Yin , Ceyao Zhang , Min Hu , Kai Chen

Time series data measure how environments change over time and drive decision-making in critical domains like finance and healthcare. A common goal in analyzing time series data is to understand the underlying events that cause the observed…

Artificial Intelligence · Computer Science 2025-05-26 Mingtian Tan , Mike A. Merrill , Zack Gottesman , Tim Althoff , David Evans , Tom Hartvigsen

Advanced epidemic forecasting is critical for enabling precision containment strategies, highlighting its strategic importance for public health security. While recent advances in Large Language Models (LLMs) have demonstrated effectiveness…

Machine Learning · Computer Science 2025-05-20 Chenghua Gong , Rui Sun , Yuhao Zheng , Juyuan Zhang , Tianjun Gu , Liming Pan , Linyuan Lv

Time series analysis is critical for emerging net- work intelligent control and management functions. However, existing statistical-based and shallow machine learning models have shown limited prediction capabilities on multivariate time…

Machine Learning · Computer Science 2026-03-13 Yufeng Xin , Ethan Fan

Foundation models, particularly Large Language Models (LLMs), have revolutionized text and video processing, yet time series data presents distinct challenges for such approaches due to domain-specific features such as missing values,…

Machine Learning · Computer Science 2025-02-12 Defu Cao , Wen Ye , Yizhou Zhang , Yan Liu

Time series forecasting remains a challenging task, particularly in the context of complex multiscale temporal patterns. This study presents LLM-Mixer, a framework that improves forecasting accuracy through the combination of multiscale…

Recent research has shown that large language models (LLMs) can be effectively used for real-world time series forecasting due to their strong natural language understanding capabilities. However, aligning time series into semantic spaces…

Machine Learning · Computer Science 2024-12-03 Lingzheng Zhang , Lifeng Shen , Yimin Zheng , Shiyuan Piao , Ziyue Li , Fugee Tsung

Recently, Large Language Models (LLMs) have demonstrated great potential in various data mining tasks, such as knowledge question answering, mathematical reasoning, and commonsense reasoning. However, the reasoning capability of LLMs on…

Computation and Language · Computer Science 2025-05-22 He Chang , Chenchen Ye , Zhulin Tao , Jie Wu , Zhengmao Yang , Yunshan Ma , Xianglin Huang , Tat-Seng Chua

Transformer-based and CNN-based methods demonstrate strong performance in long-term time series forecasting. However, their high computational and storage requirements can hinder large-scale deployment. To address this limitation, we…

Machine Learning · Computer Science 2026-01-08 Juntong Ni , Zewen Liu , Shiyu Wang , Ming Jin , Wei Jin

The recent surge in Multimodal Large Language Models (MLLMs) has showcased their remarkable potential for achieving generalized intelligence by integrating visual understanding into Large Language Models.Nevertheless, the sheer model size…

Computation and Language · Computer Science 2024-07-30 Shilin Xu , Xiangtai Li , Haobo Yuan , Lu Qi , Yunhai Tong , Ming-Hsuan Yang