English
Related papers

Related papers: Timer-XL: Long-Context Transformers for Unified Ti…

200 papers

Time series forecasting plays a critical role in decision-making across many real-world applications. Unlike data in vision and language domains, time series data is inherently tied to the evolution of underlying processes and can only…

Machine Learning · Computer Science 2026-02-03 Suhan Guo , Bingxu Wang , Shaodan Zhang , Furao Shen

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

Machine Learning · Computer Science 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting…

In-context learning, the ability of large language models to perform tasks using only examples provided in the prompt, has recently been adapted for time series forecasting. This paradigm enables zero-shot prediction, where past values…

Machine Learning · Computer Science 2025-11-04 Andreas Auer , Patrick Podest , Daniel Klotz , Sebastian Böck , Günter Klambauer , Sepp Hochreiter

Recent research has challenged the necessity of complex deep learning architectures for time series forecasting, demonstrating that simple linear models can often outperform sophisticated approaches. Building upon this insight, we introduce…

Machine Learning · Computer Science 2024-10-30 Remi Genet , Hugo Inzirillo

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

Machine Learning · Computer Science 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Time series prediction is crucial for understanding and forecasting complex dynamics in various domains, ranging from finance and economics to climate and healthcare. Based on Transformer architecture, one approach involves encoding…

Machine Learning · Computer Science 2024-05-24 Xin Cheng , Xiuying Chen , Shuqi Li , Di Luo , Xun Wang , Dongyan Zhao , Rui Yan

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

Machine Learning · Computer Science 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

We propose the Taylorformer for random processes such as time series. Its two key components are: 1) the LocalTaylor wrapper which adapts Taylor approximations (used in dynamical systems) for use in neural network-based probabilistic…

Machine Learning · Computer Science 2024-09-24 Omer Nivron , Raghul Parthipan , Damon J. Wischik

Time series forecasting aims to model temporal dependencies among variables for future state inference, holding significant importance and widespread applications in real-world scenarios. Although deep learning-based methods have achieved…

Machine Learning · Computer Science 2026-05-21 Zesen Wang , Lijuan Lan , Yonggang Li

We propose an efficient design of Transformer-based models for multivariate time series forecasting and self-supervised representation learning. It is based on two key components: (i) segmentation of time series into subseries-level patches…

Machine Learning · Computer Science 2023-03-07 Yuqi Nie , Nam H. Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Although pre-trained transformers and reprogrammed text-based LLMs have shown strong performance on time series tasks, the best-performing architectures vary widely across tasks, with most models narrowly focused on specific areas, such as…

Machine Learning · Computer Science 2024-11-27 Shanghua Gao , Teddy Koker , Owen Queen , Thomas Hartvigsen , Theodoros Tsiligkaridis , Marinka Zitnik

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

Generative models have gained significant attention in multivariate time series forecasting (MTS), particularly due to their ability to generate high-fidelity samples. Forecasting the probability distribution of multivariate time series is…

Machine Learning · Computer Science 2025-02-13 Shibo Feng , Peilin Zhao , Liu Liu , Pengcheng Wu , Zhiqi Shen

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

Machine Learning · Computer Science 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav