English
Related papers

Related papers: LLM-Mixer: Multiscale Mixing in LLMs for Time Seri…

200 papers

In urban computing, precise and swift forecasting of multivariate time series data from traffic networks is crucial. This data incorporates additional spatial contexts such as sensor placements and road network layouts, and exhibits complex…

Machine Learning · Computer Science 2024-12-19 Tongtong Zhang , Zhiyong Cui , Bingzhang Wang , Yilong Ren , Haiyang Yu , Pan Deng , Yinhai Wang

Transformers have gained popularity in time series forecasting for their ability to capture long-sequence interactions. However, their high memory and computing requirements pose a critical bottleneck for long-term forecasting. To address…

Machine Learning · Computer Science 2023-12-12 Vijay Ekambaram , Arindam Jati , Nam Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and…

Machine Learning · Computer Science 2024-08-12 Rui Cao , Qiao Wang

Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using…

Machine Learning · Computer Science 2026-01-14 Jiacheng You , Jingcheng Yang , Yuhang Xie , Zhongxuan Wu , Xiucheng Li , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xinyang Chen

Forecasting irregularly sampled multivariate time series with missing values (IMTS) is a fundamental challenge in domains such as healthcare, climate science, and biology. While recent advances in vision and time series forecasting have…

Machine Learning · Computer Science 2026-02-27 Christian Klötergens , Tim Dernedde , Lars Schmidt-Thieme , Vijaya Krishna Yalavarthi

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel…

Machine Learning · Computer Science 2025-03-12 Shule Hao , Junpeng Bao , Chuncheng Lu

Large Language Models (LLMs) have been applied to time series forecasting tasks, leveraging pre-trained language models as the backbone and incorporating textual data to purportedly enhance the comprehensive capabilities of LLMs for time…

Computation and Language · Computer Science 2025-04-15 Zhengke Sun , Hangwei Qian , Ivor Tsang

Long-term time series forecasting requires models that simultaneously capture rapid oscillations, medium-range periodicities, and slowly evolving macro-trends from a fixed look-back window. Existing lightweight MLP-based models typically…

Machine Learning · Computer Science 2026-05-18 Ahmed Cherif

Time series data, including univariate and multivariate ones, are characterized by unique composition and complex multi-scale temporal variations. They often require special consideration of decomposition and multi-scale modeling to…

Machine Learning · Computer Science 2024-03-26 Shuhan Zhong , Sizhe Song , Weipeng Zhuo , Guanyao Li , Yang Liu , S. -H. Gary Chan

This paper introduces a novel approach that leverages Large Language Models (LLMs) and Generative Agents to enhance time series forecasting by reasoning across both text and time series data. With language as a medium, our method adaptively…

Artificial Intelligence · Computer Science 2024-10-31 Xinlei Wang , Maike Feng , Jing Qiu , Jinjin Gu , Junhua Zhao

Recent advances in Large Language Models (LLMs) have demonstrated new possibilities for accurate and efficient time series analysis, but prior work often required heavy fine-tuning and/or ignored inter-series correlations. In this work, we…

Traffic forecasting task is significant to modern urban management. Recently, there is growing attention on large-scale forecasting, as it better reflects the complexity of real-world traffic networks. However, existing models often exhibit…

Machine Learning · Computer Science 2025-12-10 Yongyao Wang , Jingyuan Wang , Xie Yu , Jiahao Ji , Chao Li

Spatiotemporal forecasting is critical in applications such as traffic prediction, climate modeling, and environmental monitoring. However, the prevalence of missing data in real-world sensor networks significantly complicates this task. In…

Machine Learning · Computer Science 2025-01-20 Muhammad Bilal , Luis Carretero Lopez

Time series forecasting plays a significant role in finance, energy, meteorology, and IoT applications. Recent studies have leveraged the generalization capabilities of large language models (LLMs) to adapt to time series forecasting,…

Machine Learning · Computer Science 2026-05-12 Hao Liu , Xiaoxing Zhang , Chun Yang , Xiaobin Zhu

Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data,…

Machine Learning · Computer Science 2024-05-08 Xiyuan Zhang , Ranak Roy Chowdhury , Rajesh K. Gupta , Jingbo Shang

Using pre-trained large language models (LLMs) as a backbone for time series prediction has recently attracted growing research interest. Existing approaches typically split time series into patches, map them to the token space of LLMs via…

Machine Learning · Computer Science 2026-03-09 Xinyu Zhang , Shanshan Feng , Xutao Li , Kenghong Lin , Fan Li , Pengfei Jia

Recently, there has been a growing interest in Long-term Time Series Forecasting (LTSF), which involves predicting long-term future values by analyzing a large amount of historical time-series data to identify patterns and trends. There…

Machine Learning · Computer Science 2026-02-17 Aitian Ma , Dongsheng Luo , Mo Sha

Time series forecasting plays a critical role in decision-making across many real-world applications. Unlike data in vision and language domains, time series data is inherently tied to the evolution of underlying processes and can only…

Machine Learning · Computer Science 2026-02-03 Suhan Guo , Bingxu Wang , Shaodan Zhang , Furao Shen

Modeling multiscale patterns is crucial for long-term time series forecasting (TSF). However, redundancy and noise in time series, together with semantic gaps between non-adjacent scales, make the efficient alignment and integration of…

Machine Learning · Computer Science 2026-02-19 Xu Zhang , Qitong Wang , Peng Wang , Wei Wang

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

Machine Learning · Computer Science 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao