English
Related papers

Related papers: Probabilistic Decomposition Transformer for Time S…

200 papers

Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between…

Machine Learning · Computer Science 2019-09-20 Shun-Yao Shih , Fan-Keng Sun , Hung-yi Lee

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

Machine Learning · Computer Science 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

Transformer-based models have emerged as promising tools for time series forecasting. However, these model cannot make accurate prediction for long input time series. On the one hand, they failed to capture global dependencies within time…

Machine Learning · Computer Science 2023-08-16 YanJun Zhao , Ziqing Ma , Tian Zhou , Liang Sun , Mengni Ye , Yi Qian

Time series forecasting is an important problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. In this paper, we propose to tackle such forecasting problem with…

Machine Learning · Computer Science 2020-01-06 Shiyang Li , Xiaoyong Jin , Yao Xuan , Xiyou Zhou , Wenhu Chen , Yu-Xiang Wang , Xifeng Yan

Long-term time series forecasting (LTSF) represents a critical frontier in time series analysis, characterized by extensive input sequences, as opposed to the shorter spans typical of traditional approaches. While longer sequences…

Machine Learning · Computer Science 2024-10-17 Jinliang Deng , Feiyang Ye , Du Yin , Xuan Song , Ivor W. Tsang , Hui Xiong

We propose the Taylorformer for random processes such as time series. Its two key components are: 1) the LocalTaylor wrapper which adapts Taylor approximations (used in dynamical systems) for use in neural network-based probabilistic…

Machine Learning · Computer Science 2024-09-24 Omer Nivron , Raghul Parthipan , Damon J. Wischik

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

When solving forecasting problems including multiple time-series features, existing approaches often fall into two extreme categories, depending on whether to utilize inter-feature information: univariate and complete-multivariate models.…

Artificial Intelligence · Computer Science 2024-08-20 Jaehoon Lee , Hankook Lee , Sungik Choi , Sungjun Cho , Moontae Lee

The performance of time series forecasting has recently been greatly improved by the introduction of transformers. In this paper, we propose a general multi-scale framework that can be applied to the state-of-the-art transformer-based time…

Machine Learning · Computer Science 2023-02-08 Amin Shabani , Amir Abdi , Lili Meng , Tristan Sylvain

Although Transformers excel in natural language processing, their extension to time series forecasting remains challenging due to insufficient consideration of the differences between textual and temporal modalities. In this paper, we…

Machine Learning · Computer Science 2025-10-09 Zhipeng Liu , Peibo Duan , Xuan Tang , Baixin Li , Yongsheng Huang , Mingyang Geng , Changsheng Zhang , Bin Zhang , Binwu Wang

Accurate and reliable energy forecasting is essential for power grid operators who strive to minimize extreme forecasting errors that pose significant operational challenges and incur high intra-day trading costs. Incorporating planning…

Computers and Society · Computer Science 2026-05-13 Raffael Theiler , Leandro Von Krannichfeldt , Giovanni Sansavini , Michael F. Howland , Olga Fink

Periodicity is a fundamental characteristic of time series data and has long played a central role in forecasting. Recent deep learning methods strengthen the exploitation of periodicity by treating patches as basic tokens, thereby…

Machine Learning · Computer Science 2025-10-07 Yiming Niu , Jinliang Deng , Yongxin Tong

While numerous forecasters have been proposed using different network architectures, the Transformer-based models have state-of-the-art performance in time series forecasting. However, forecasters based on Transformers are still suffering…

Machine Learning · Computer Science 2024-11-06 Kun Yi , Jingru Fei , Qi Zhang , Hui He , Shufeng Hao , Defu Lian , Wei Fan

To the naked eye, stock prices are considered chaotic, dynamic, and unpredictable. Indeed, it is one of the most difficult forecasting tasks that hundreds of millions of retail traders and professional traders around the world try to do…

Computational Finance · Quantitative Finance 2025-02-17 Shuozhe Li , Zachery B Schulwol , Risto Miikkulainen

Despite the high performance of neural network-based time series forecasting methods, the inherent challenge in explaining their predictions has limited their applicability in certain application areas. Due to the difficulty in identifying…

Machine Learning · Computer Science 2023-01-09 Ozan Ozyegen , Juyoung Wang , Mucahit Cevik

In this work, we propose \texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion…

Machine Learning · Computer Science 2021-07-09 Kashif Rasul , Calvin Seward , Ingmar Schuster , Roland Vollgraf

Transformer-based models have shown strong performance in time-series forecasting by leveraging self-attention to model long-range temporal dependencies. However, their effectiveness depends critically on the quality and structure of input…

Machine Learning · Computer Science 2026-02-11 Saurish Nagrath , Saroj Kumar Panigrahy

This paper introduces a data-driven time embedding method for modeling long-range seasonal dependencies in spatiotemporal forecasting tasks. The proposed approach employs Dynamic Mode Decomposition (DMD) to extract temporal modes directly…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Xudong Wang , Lijun Sun

Our world is ambiguous and this is reflected in the data we use to train our algorithms. This is particularly true when we try to model natural processes where collected data is affected by noisy measurements and differences in measurement…

Machine Learning · Computer Science 2023-07-19 Jörg K. H. Franke , Frederic Runge , Frank Hutter

Cross-domain time series forecasting is a valuable task in various web applications. Despite its rapid advancement, achieving effective generalization across heterogeneous time series data remains a significant challenge. Existing methods…

Artificial Intelligence · Computer Science 2025-11-04 Tingyue Pan , Mingyue Cheng , Shilong Zhang , Zhiding Liu , Xiaoyu Tao , Yucong Luo , Jintao Zhang , Qi Liu